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The combination of the compactness of nctworlcs, featuring small diameters, and their complex 
architectures results in a variety of critical effects dramatically different from those in coopera- 
tive systems on lattices. In the last few years, researchers have made important steps toward 
understanding the qualitatively new critical phenomena in complex networks. We review the re- 
sults, concepts, and methods of this rapidly developing field. Here we mostly consider two closely 
related classes of these critical phenomena, namely structural phase transitions in the network 
architectures and transitions in cooperative models on networks as substrates. We also discuss 
systems where a network and interacting agents on it influence each other. We overview a wide 
range of critical phenomena in equilibrium and growing networks including the birth of the gi- 
ant connected component, percolation, fc-core percolation, phenomena near epidemic thresholds, 
condensation transitions, critical phenomena in spin models placed on networks, synchronization, 
and self-organized criticality effects in interacting systems on networks. We also discuss strong 
finite size effects in these systems and highlight open problems and perspectives. 
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By definition, complex networks are networks with 
more complex architectures than classical random graphs 
with their "simple" Poissonian distributions of connec- 
tions. The great majority of real- world networks, in- 
cluding the World Wide Web, the Internet, basic cellular 
networks, and many others, are complex ones. The com- 
plex organization of these nets typically implies a skewed 
distribution of connections with many hubs, strong in- 
homogeneity and high clustering, as well as non-trivial 
temporal evolution. These architectures are quite com- 
pact (with a small degree of separation between vertices), 
infinitely dimensional, which is a fundamental property 
of various networks — small worlds. 

Physicists intensively studied structural properties of 
complex networks since the end of 90's, but the current 
focus is essentially on cooperative systems defined on net- 
works and on dynamic processes taking place on net- 
works. In recent years it was revealed that the extreme 
compactness of networks together with their complex or- 
ganization result in a wide spectrum of non-traditional 
critical effects and intriguing singularities. This paper 
reviews the progress in the understanding of the unusual 
critical phenomena in networked systems. 

One should note that the tremendous current inter- 
est in critical effects in networks is explained not only by 
numerous important applications. Critical phenomena in 
disordered systems were among the hottest fundamental 
topics of condensed matter theory and statistical physics 
in the end of XX century. Complex networks imply a 
new, practically unknown in condensed matter, type of 
strong disorder, where fluctuations of structural charac- 
teristics of vertices (e.g., the number of neighbors) may 
greatly exceed their mean values. One should add to this 
large-scale inhomogeneity which is signiflcant in many 
complex networks — statistical properties of vertices may 
strongly differ in different parts of a network. 

The first studie s of a critical phenomenon in a net- 
work were made b y Solomonoff and Rapoportl ( 195 ih and 
lErdos and Renvil ( 1959f l who introduced classical random 
graphs and described the structural phase transition of 
the birth of the giant connected component. These sim- 
plest random graphs were widely used by physicists as 
substrates for various cooperative models. 

Another basic small-world substrate in statistical me- 
chanics and condensed matter theory is the Bethe 
lattice — an infinite regular tree — and its diluted varia- 
tions. The Bethe lattice usually allows exact analytical 
treatment, and, typically, each new cooperative model is 
inspected on this network (as well as on the infinite fully 
connected graph). 

Studies of critical phenomena in complex networks es- 
sentially use approaches developed for these two fun- 
damental, related classes of networks — classical random 
graphs and the Bethe lattices. In these graphs and many 
others, small and finite loops (cycles) are rare and not es- 
sential, the architectures are locally tree-like, which is a 
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great simplifying feature extensively exploited. One may 
say, the existing analytical and algorithmic approaches 
already allow one to exhaustively analyse any locally 
tree-like network and to describe cooperative models on 
it. Moreover, the tree ansatz works well even in numerous 
important situations for loopy and clustered networks. 
We will discuss in detail various techniques based on this 
standard approximation. It is these techniques, includ- 
ing, in particular, the Bethe-Peierls approximation, that 
are main instruments for study the critical effects in net- 
works. 

Critical phenomena in networks include a wide range of 
issues: structural changes in networks, the emergence of 
critical — scale-free — network architectures, various per- 
colation phenomena, epidemic thresholds, phase transi- 
tions in cooperative models defined on networks, criti- 
cal points of diverse optimization problems, transitions 
in co-evolving couples — a cooperative model and its net- 
work substrate, transitions between different regimes in 
processes taking place on networks, and many others. We 
will show that many of these critical effects are closely 
related and universal for different models and may be 
described and explained in the framework of a unified 
approach. 

The outline of this review is as follows. In Sec. HTl we 
briefly describe basic models of complex networks. Sec- 
tion mil contains a discussion of structural phase transi- 
tions in networks: the birth of the giant connected com- 
ponent of a complex random network and various related 
percolation problems. In Sec. II VI we describe condensa- 
tion phenomena, where a finite fraction of edges, trian- 
gles, etc. are attached to a single vertex. Section |V] 
overviews main critical effects in the disease spreading. 
Sections IVII I VIII and IVIIII discuss the Ising, Potts and 
XY models on networks. We use the Ising model to 
introduce main techniques of analysis of interacting sys- 
tems in networks. We place a comprehensive description 
of this analytical apparatus, more useful for theoretical 
physicists, in the Appendix. Section IIXI contains a gen- 
eral phcnomcnological approach to critical phenomena in 
networks. In Sees. 1x1 and IXII we discuss specifics of syn- 
chronization and self-organized criticality on networks. 
Section IXIII brieflv describes a number of other critical ef- 
fects in networks. In Sec. lXIlIl we indicate open problems 
and perspectives of this field. Note that for a few inter- 
esting problems, as yet uninvestigated for complex net- 
works, we discuss only the classical random graph case. 



II. MODELS OF COMPLEX NETWORKS 

In this section we briefly introduce basic networks, 
which are used as substrates for models, and basic 
terms. For more d etail se e books and reviews of 
[Albert and Barabasil (|2002|). Dorogovtsev an d Mendej 
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A. Structural characteristics of networks 

A random network is a statistical ensemble, where 
each member — a particular configuration of vertices and 
edges — is realized with some prescribed probability (sta- 
tistical weights). Each graph of N vertices may be de- 
scribed by its adjacency NxN matrix (fly), where = 
if edges between vertices i and j are absent, and > 
otherwise. In simple graphs, = 0, 1. In weighted net- 
works, the adjacency matrix elements are non- negative 
numbers which may be non- integer — weights of edges. 
The simplest characteristic of a vertex in a graph is its 
degree q, that is the number of its nearest neighbors. 
In physics this is often called connectivity. In directed 
graphs, at least some of edges are directed, and one 
should introduce in- and out-degrees. For random net- 
works, a vertex degree distribution P{q) is the first sta- 
tistical measure. 

The presence of connections between the nearest neigh- 
bors of a vertex i is described by its clustering coeffi- 
cient C{qi) = ti/[qi{qi — l)/2], where ti is the number 
of triangles (loops of length 3) attached to this vertex, 
and qi{qi — l)/2 is the maximum possible number of 
such triangles. Note that in general, the mean clustering 
(C) = 'Yliq P{'i)C^{q) should not coincide with the cluster- 
ing coefficient (transitivity) C = {ti) / {qi (qi — l) /2) which 
is three times the ratio of the total number of triangles in 
the network and the total number of connected triples of 
vertices. A connected triple here is a vertex with its two 
nearest neighbors. A triangle can be treated as a three 
connected triples, which explains the coefficient 3. 

A loop (simple cycle) is a closed path visiting each its 
vertex only once. By definition, trees are graphs without 
loops. 

For each pair of vertices i and j connected by at least 
one path, one can introduce the shortest path length, 
the so-called intervertex distance iij, the corresponding 
number of edges in the shortest path. The distribu- 
tion of intervertex distances Vii) describes the global 
structure of a random network, and the mean interver- 
tex distance £{N) characterizes the "compactness" of a 
network. In finite-dimensional systems, J{N) ~ iV^/'^. 
We, however, mostly discuss networks with the small- 
world phenomenon — the so called small worlds, where £ 
increases with the total number of vertices N slower than 
any positive power, i.e., d = oo (jWattsl . 119991) . Typically 
in networks, £(N) ~ InA^. 

Another important characteristic of a vertex (or edge) 
is its betweenness centrality (or, which is the same, load): 
the number of the shortest paths between other vertices 
which run through this vertex (or edge). In more strict 
terms, the betweenness centrality b(v) of vertex v is de- 
fined as follows. Let s{i,j)>0 be the number of the shor- 
test paths between vertices i and j. Let s{i,v,j) be the 
number of these paths, passing through vertex v. Then 
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FIG. 1 The Cayley tree (on the left) versus the Bethe lattice 
(on the right). 
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^k^^ = Si^u^^j s{i,v, j) / s{i, i). A betweenness centrality 
distribution is introduced for a random network. 

A basic notion is a giant connected component analo- 
gous to the percolation cluster in condensed matter. This 
is a set of mutually reachable vertices and their inter- 
connections, containing a finite fraction of vertices of an 
infinite network. Note that in physics the infinite net- 
work limit, — !■ cxD, is also called the thermodynamic 
limit. The relative size of the giant component (the rel- 
ative number of its vertices) and the size distribution of 
finite connected components describe the topology of a 
random network. 



B. Cayley tree versus Bethe lattice 

Two very different regular graphs are extensively used 
as substrates for cooperative models. Both are small 
worlds if the degree of their vertices exceeds 2. In the 
(regular) Cayley tree, explained on Fig.[l] a finite fraction 
of vertices are dead ends. These vertices form a sharp 
border of this tree. There is a central vertex, equidistant 
from the boundary vertices. The presence of the border 
essentially determines the physics of interacting systems 
on the Cayley tree. 

The Bethe lattice is an infinite regular graph (see 
Fig. [T|). All vertices in a Bethe lattice are topolog- 
ically equivalent, and boundaries are absent. Note 
that in the thermodynamic limit, the so called random 
regul ar graphs asymptotical l y app roach the Bethe lat- 
tices ( Johnston and Plechad 1998f ). The random regular 
graph is a maximally random network of vertices of equal 
degree. It is constructed of vertices with the same num- 
ber (degree) of stubs by connecting pairs of the stubs in 
all possible ways. 
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C. Equilibrium random trees versus growing ones 



FIG. 2 Statistical ensembles of equilibrium random con- 
nected trees (left-hand side) and of growing connected trees 
(right-hand side) for N = 1,2, 3, 4. The ensemble of equi- 
librium trees consists of all possible connected trees of A'^ la- 
belled vertices, where each tree is taken with the same weight. 
The ensemble of growing (causal) trees is the following con- 
struction. Its members are the all possible connected trees of 
size that can be made by sequential attachment of new la- 
belled vertices. Each of these trees of N vertices is taken with 
the same weight. Notice that at A' = 3, one of the labelled 
graphs of the equilibrium ensemble is absent in the ensemble 
of growing trees. At A = 4, we indicate the numbers of iso- 
morphic graphs in both ensembles. (By definition, isomorphic 
graphs differ from each other only by vertex labels.) Already 
at = 4, the equilibrium random tree is less compact, since 
the probability of realization of the chain is higher in this case. 



with equal probability — Fig. [U left side. The degree 
distributions of these networks are rapidly decreasing, 
P{q) = e^^ / {q — I)!. However one may arrive at scale- 
free degree distributions P{q) ~ q~'^ by, for example, 
introducing special degree dependent statistical weights 
of different members of these ensembles. In this case, if 
7 > 3, then dh = 2, and if 2 < 7 < 3, then the fractal 
dimension is d/i = (7 — l)/(7 — 2) > 2. 

In contrast to this, the growing (causal, recursive) ran- 
dom connected trees are small worlds. These trees are 
constructed by sequential attachment of new (labelled) 
vertices — Fig. [21 right side. The rule of this attachment 
or, alternatively, specially introduced degree dependent 
weights for different realizations, determine the resulting 
degree distributions. The mean intervertex distance in 
these graphs Z ~ In A^ . Thus, even with identical degree 
distributions, the equilibrium random trees and growing 
ones have quite different geometries. 



Remarkably, random connected trees (i.e., consisting of 
a single connected component) may or may n ot be small 
worlds (Bialas et al, 2003; Bur da aLl . [200lh . The equi- 
librium random connected trees have extremely extended 
architectures characterising by the fractal (Hausdorff) 
dimension du — 2, i.e., '1{N) ^ N^^'^. These random 
trees are the statistical ensembles that consist of all pos- 
sible connected trees with A^ labelled vertices, taken 



D. Classical random graphs 

Two simplest models of random networks are so close 
(one may say, asymptotically coincident in the thermo- 
dynamic limit) that they are together called classical 
random graphs. The Gilbert model, or the G^ p model, 
(|Gilbertl . ll959l : [Solomonoff and Rapoportj . 119511 ) IS a ran- 
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dom graph where an edge between each pair of N vertices 
is present with a fixed probabiHty p. 

The shghtly more difficult for ana l ytical treatment 
Erdos-Renyi model ferdos and Renvl 11959"), which is 
also called the G„m model, is a statistical ensemble where 
all members — all possible graphs with a given numbers 
of vertices, N, and edges, M, — have equal probability of 
realization. The relationship between the Erdos-Renyi 
model and the Gilbert one is given by the following 
equalities for the mean degree: (q) ~ 2M/N — pN. If 
{q)/N — > as — !■ oo, a network is sparse, i.e., it is 
far more sparse than a fully connected graph. So, the 
Gilbert model is sparse when p{N — > oo) — > 0. 

The classical random graphs are maximally random 
graphs under a single constraint — a fixed mean degree 
(<?). Their degree distribution is Poissonian, P{q) — 



E. Uncorrelated networks with arbitrary degree 
distributions 

One should emphasize that in a random network, the 
degree distribution of the nearest neighbor Pnniq) (or, 
which is the same, the degree distribution of an end ver- 
tex of a randomly chosen edge) does not coincide with 
the vertex degree distribution P{q). In general random 
networks, 



Pnniq) 



qPjq) 



>{q), 



(1) 



see Fig. |31 These simple relations play a key role in the 
theory of complex networks. 

By definition, in uncorrelated networks correlations are 
absent, in particular, there are no correlations between 
degrees of the nearest neighbors. That is, the joint distri- 
bution of degrees of the nearest neighbor vertices factors 
into the product: 



P{q,q') 



qP{q)q'P{q') 

{q? 



(2) 



Thus, the architectures of uncorrelated networks are 
determined by their degree distributions. The Erdos- 
Renyi and Gilbert models are simple uncorrelated net- 
works. Below we list the models of complex uncorrelated 



P{q) 



qP{q)/{q) q'P{q')/{q) 



<q) 



(q'}/<q} 



<q'>/<q) 



FIG. 3 The distribution of connections and the mean degree 
of a randomly chosen vertex (on the left) differ sharply from 
those of end vertices of a randomly chosen edge (on the right) . 



networks, which are actually very close to each other in 
the thermodynamic limit. In this limit all these networks 
are locally tree-like (if they are sparse, of course), with 
only infinite loops. 



1. Configuration model 

The direct generalization of the Erdos-Renyi graphs is 
the fa mous configuration model formulated by BoUobasI 
see also the work of lBender and Canfieldl (|l978l ). 
In graph theory, these networks are also called random 
labelled graphs with a given degree sequence. The con- 
figuration model is the statistical ensemble, whose mem- 
bers are realized with equal probability. These members 
are all possible graphs with a given set {Nq — NP{q)}, 
^ = 0,1,2,3,..., where Nq is the number of vertices of de- 
gree q. In simple terms, the configuration model provides 
maximally random graphs with a given degree distribu- 
tion P{q). 

This construction may be also portrayed in more 
graphic terms: (i) Attach stubs — edge-halves — to N ver- 
tices according to a given sequence of numbers {Nq}. (ii) 
Pair randomly chosen stubs together into edges. Since 
stubs of the same vertex may be paired together, the con- 
figuration model, in principle, allows a number of loops of 
length one as well as multiple connections. Fortunately, 
these may be neglected in many problems. 

Using relation ^ gives the formula Z2 = {q^) — (q) 
for the mean number of the second nearest neighbors of 
a vertex. That is, the mean branching coefficient of the 
configuration model and, generally, of an uncorrelated 
network is 



(q) 



Zl 



(q) 



(3) 



where zi = (q). Consequently, the mean number of the 
ith nearest neighbors of a vertex is zi = z\(z2l z\Y~^ . So 
the mean intervertex distance is ?(iV) = \mN j \m(ziI z\) 
(|Newman et a/.l . l200lt) . 

The distribution of the intervertex distances in the 
configuration model is quite narrow. Its relative width 
approaches zero in the thermodynamic limit. In other 
words, in this limit, almost all vertic es of the configura- 
tion m odel are mutually equidistant ( Dorogovtsev et g]] . 
l2003al ). We emphasise that this remarkable property is 
valid for a very wide class of networks with the small- 
world phenomenon. 

The configuratio n model was generalized to bipartite 
networks (New man et a/.l . l200lh . By definition, a bipar- 
tite graph contains two kinds of vertices, and only vertices 
of different kinds may be interlinked. In short, the con- 
figuration model of a bipartite network is a maximally 
random bipartite graph with two given degree distribu- 
tions for two types of vertices. 
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2. Static model 



The direct gen eralization of the Gilbert model is 

2nnih 



see also 



works 
and 



the static one (Goh et a-.. . 

of IChuneand Lul (IpOoiT ^ ISoderberd (I2002D , 
ICaldarelh et al\ \2m'£ 7 These are graphs with a given 
sequence of desired degrees. These desired degrees {di} 
play role of "hidden variables" defined on vertices i = 
l,2,...,iV. Pairs of vertices {ij) are connected with 
probabilities pij = 1 — exp{—didj/N{d)). The degree 
distribution of resulting network P{q) tends to a given 
distribution of desired degrees at sufficiently large q. It 
is important that at small enough di, the probability 
Pij = didj / [N {d)). The exponential function keeps the 
probability below 1 even if didj > N{d) which is possible 
if the desired degree distribution is heavy tailed. 



3. Statistical mechanics of uncorrelated networks 

It is also easy to generate random networks 
by using a stand ar d thermodynamic a p proac h, see 
Burda eit oLI (l200lh. iBauer and Bernard! ((20021 ). and 
Dorogovtsev et ali (|2003bl ). In particular, assuming that 
the number of vertices is constant, one may introduce 
"thermal" hopping of edges or their rewiring. These 
processes lead to relaxational dynamics in the system 
of edges connecting vertices. The final state of this re- 
laxation process — an equilibrium statistical ensemble — 
may be treated as an "equilibrium random network" . 
This network is uncorrelated if the rate/probability of 
rewiring depends only on degrees of host vertices and 
on degrees of targets, and, in addition, if rewirings are 
independent. The resulting diverse degree distributions 
are determined by two factors: a specific degree depen- 
dent rewiring and the mean vertex degree in the network. 
Note that if multiple connections are allowed, this con- 
struction is essentially equival ent to the simple balls-in - 
boxes (or backgammon) model ( Bialas et aLl . l20dolll997f ). 
where ends of edges — balls — are statistically distributed 
among vertices — boxes. 



4. Cutoffs of degree distributions 

Heavy tailed degree distributions P{q) = {N{q))/N in 
finite networks, inevitably end by a rapid drop at large 
degrees — cutoff. Here, {N{q)) is the number of vertices of 
degree q in a random network, averaged over all members 
of the corresponding statistical ensemble. The knowledge 
of the size dependence of the cutoff position, gcut(^) is 
critically important for the estimation of various size ef- 
fects in complex networks. The difficulty is that the form 
of qcut{N) is highly model dependent. 

We here present estimates of gcut(^) in uncorrelated 
scale- free networks, where P{q) ~ The results es- 

sentially depend on (i) whether exponent 7 is above or 
below 3, and (ii) whether multiple connections are al- 



lowed in the network or not. 

In the range 7 > 3, the resulting estimates are the same 
in n etworks with multip le connections (jBurda et ali 
l200l[ ) and without them ( Dorogovtsev et ai . 12005'). In 
this range, strict calculation of a degree distribution tak- 
ing into account all members of a statistical network en- 
semble leads to gcut {N) ~ rpj^g ^^^g^j number of 
the members of an equilibrium network ensemble (e.g., 
for the configuration model) is huge, say, of the order of 
iV!. However, in empirical research or simulations, en- 
sembles under investigation have rather small number n 
of members — a whole ensemble may consist of a single 
empirically studied map or of a few runs in a simulation. 
Often, only a single network configuration is used as a 
substrate in simulations of a cooperative model. In these 
measurements, a natural cutoff oi an observed degree dis- 
tribut ion arises ( Cohen et all \20Q(i [Dorogovtsev et all . 

Its degree, much lower than N^/'^, is estimated 
from the following condition. In the n studied ensemble 
members, a vertex degree exceeding q^ut should occur 
one time: nN /J^^^jy-) dqP{q) ~ 1. This gives the really 
observable cutoff: 



'Zcut(iV,7>3)^(n7V)i/(^-i) 



(4) 
and 



is a typical situation 
'?cut(A^,7 > 3) - otherwise. 

In the interesting range 2 < 7 < 3, the cut- 
off essentially depends on the kind of an uncorre- 
lated network. If in an uncorrelated network, mul- 
tiple connections are allowed, then gcut(-^, 2<7<3) '-^ 
TV^/^T"!). In uncorrelated networks without mul- 
tiple con nections, (7cut(A^, 2<7<3) ~ N'^/'^ < 
jVi/(7-i) dBurd a and Krzvwickil |2003|) . affhough see 
[Dorogovtsev et a l. (200^ for a different estimate for a 
specific model without multiple connections. For discus- 
sion of the cutoff p roblem in the stati c model in this range 
o f exponent 7, see Lee et oil ( 2006al ). 

ISeved-allaei et al. ( 2006[ ) found that in scale-free un- 
correlated networks with exponent 7 < 2, the cutoff is 
(7cut(A^, 1<7<2) ^ N^^^. They showed that the mean 
degree of these networks increases with N: namely, 
(q) ~ Ar(2-7)/7. 

For the sake of completeness, we here men- 
tion that in growing scal e-free recursive n e tworks , 
qn„t(jV,7>2) ^ Ari/( 7-i ) dPorogovtsev et l2001c ; 



Krapivskv and Redned . 120(32 : Waclaw and Sokolov 



20071 ). Note that the growing networks are surely 



correlated. 



F. Equilibrium correlated networks 

The simplest kind of correlations in a network are cor- 
relations between degrees of the nearest neighbor ver- 
tices. These correlations are described by the joint 
degree-degree distribution P{q, q'). If P{q, q') is not fac- 
torized, unlike equality (Ht , the network is correlated 
(|Maslov and Sneppenl . l200a iNewmanl . [2"002bf) . 
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The natural generalization of uncorrelated networks, 
which is still sometimes analytically treatable, are net- 
works maximally random under the constraint that their 
joint degree-degree distributions P{q, q') are fixed. That 
is, only these correlations arc present. In the hierarchy 
of equilibrium network models, this is the next, higher, 
level, after the classical random graphs and uncorrelated 
networks with an arbitrary degree distribution. Note 
that networks with this kind of correlations are still lo- 
cally tree-like in the sparse network regime. In this sense 
they may be treated as random Bethe lattices. 

These networks may be constructed in the spirit of 
the configuration model. An alternative construction — 
networks with hidden variables — directly generalizes the 
static model. These are networks, where (i) a 
random hidden variable hi with distribution Ph{h) 
is assigned to each vertex, and (ii) each pair of 
vertices (ij) is connecte d by an edge with prob- 
ability pihi,hj ) (Bogufia and Pastor-Satorrasl l2003t 
ICaldarein erZl . 120021: ISoderbertd . |2002| ). The resulting 
joint degree-degree distribution is determined by Ph{h) 
and p{h, h') functions. 



G. Loops in networks 

The above-described equilibrium network models share 
the convenient locally tree-like structure in the sparse 
network regime. The number of loops Ml of length L 
in a network allows us to quantify this important prop- 
erty. We stress that the total number of loops in these 
networks is in fact very large. Indeed, the typical inter- 
vertex distance ~ In A^, so that the number of loops with 
lengths > In should be huge. On the other hand, there 
is few loops of smaller lengths. In simple terms, if the 
second moment of the degree distribution is finite in the 
thermodynamic limit, then the number of loops of any 
given finite length is finite even in an infinite network. 
Consequently, the probability that a finite loop passes 
through a vertex is quite small, which explains the tree- 
likeness. 

In more precise terms, the number of loops 
in uncorrelated undirec ted networks is giv e n by 
the following expres s ion (iBianconi and Capoccil . 120031 : 
iBianconi and Marsilil l2005al ): 



(5) 



which is valid for sufficiently short (at least, for finite) 
loops, so that the clusterin g coefficient C(k ) = C — 
(C) = ((g2)-(g))2/(7V(q)3) (|Newmanl . [2003bh . In addi- 
tion, there are exponentially many, InA//, (x A^, loops 
of essentially longer lengths (roughly speaking, longer 
than the network diameter) . These "infinite loops" , as 
they are longer than a correlation length for a cooper- 
ative system, do not violate the validity of the tree ap- 
proximation. Moreover, without these loops — in perfect 
trees — phase transitions are often impossible, as, e.g., 



in the Ising model on a tree. The mean number of 
loops of length L passing through a vertex of degree k is 
JVLik) « [k{k-l)/{{q)N)] [{L^I)IL\ Nl-i. W ith degree 
distribution cutoffs represented in Sec. lII.E!4l formula ([5]) 
leads to finite Ml in uncorrelated networks with 7 > 3, 
and to a large number of loops 



Ml 



2L 



ia/{q)fN^('-'>y^ 



(6) 



for 2 < 7 < 3 and (g^) ^ aA^^^^'''/^, where a is a con- 
st ant^_^br_the_statistics of loops in directed networks, 
see IBianconi et al\ (I20n7f ). Note that formulas ^ and 
^ indicate that even the sparse uncorrelated networks 
are actually loopy if 7 < 3. Nonetheless, we suppose 
that the tree ansatz still works even in this situation (see 
discussion in following sections). 



H. Evolving networks 

Self-organization of non-equilibrium networks during 
their evolution (usually growth) is one of traditional ex- 
planations of network architectures with a great role of 
highly connected hubs. One should also stress that non- 
equilibrium networks inevitably have a wide spectrum of 
correlations. 

The simplest random growing network is a random re- 
cursive tree defined as follows. The evolution starts from 
a single vertex. At each time step, a new vertex is at- 
tached to a random existing one by an edge. The result- 
ing random tree has an exponential degree distribution. 



1. Preferential attachment 

To arrive at a heavy-tailed degree distribution, one 
may use preferential attachment — vertices for linking are 
chosen with probability proportional to a special function 
f{q) of their degrees (preference function). In particular, 
the scale-free networks are generated with a linear pref- 
erence function. 

A recursive network growing by the following way is 
rather representative. The growth starts with some ini- 
tial configuration, and at each time step, a new vertex is 
attached to preferentially chosen m > 1 existing vertices 
by m edges. Each vertex for attachment is chosen with 
probability, proportional to a linear function of its de- 
gree, q + A, where the constant A > — m. In particular, if 
A=Q — the proportional preference,— this is the Barabasi- 
Albert model (.Barabasi and Albert! . [T'999' ) , where the 7 
exponent of the degree distribution is equal to 3. In gen- 
eral, for a linear preferential attachment, the degree dis- 
tribution exponent is 7 = 3 4- A/m (Dorogovtscv et aQ, 
I2OOOI : iKraoivskv et aLl . l2000h . 

Among these recursive networks, the Barabasi-Albert 
model is a very special case: it has anomalously weak 
degree-degree correlations for the nearest neighbors, and 
so it is frequently treated as "almost uncorrelated" . 
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(a) 



(b) 



(c) 



(d) 




4 Examples of deterministic small worlds: fa) 



FIG. 4 Ji^xani p 

iBarabasi et aLl(l200lll. C b) of | Dorogovtsev and Mended 



and iDorogovtsev et aZ.I f2002al '). (c) of 



Andrade et al 



of 



2002) 



20051 ) 



and (Pove and Massed (|2005l ) .(d) of I Jung et al\ (|2002| ). The 
7 exponent for each of these four deterministic graphs equals 
l + ln3/ln2 = 2.585.... 



The idea of preferential attachment providing com- 
plex network architectures was well explored. The 
smooth variations of these diverse structures with var- 
ious m odel par ameters were extensively studied. For ex- 
ample, [Sz^^^f al. (2 0031 ) described the variations of the 
degree-dependent clustering in simple generalizations of 
the Barabasi- Albert model. 



2. Deterministic graphs 

Deterministic graphs often provide the only possibility 
for analytical treatment of difficult problems. Moreover, 
by using these graphs, one may mimic complex random 
networks surprisingly well. Fig. 2] demonstrates a few 
simple "scale-free" deterministic graphs, which show the 
small-world phenomenon and whose discrete degree dis- 
tribution have a power-law envelope. 




FIG. 5 A s i mple variation of the Wat ts-Strogatz model 
(IWattd [19991: IWatts and Strogatj . 1 19981 ). Adapted from 
lNewmanl72000l ). 



probability that a shortcut connects a pair of vertices sep- 
arated by Euclidean distance r decreases as r^". The re- 
sulting network geometry critically depends on the value 
of exponent a. 

We end this section with a short remark. In solid state 
physics, boundary conditions play an important role. We 
stress that as a rule, the networks under discussion have 
no borders. So the question of boundary conditions is 
meaningless here. There are very few exceptions, e.g., 
the Cayley tree. 



III. THE BIRTH OF A GIANT COMPONENT 

This is a basic structural transition in the network ar- 
chitecture. Numerous critical phenomena in cooperative 
models on networks can be explained by taking into ac- 
count the specifics of this transition in complex networks. 
The birth of a giant connected component corresponds 
to the percolation threshold notion in condensed matter. 
The study of random graphs was starte d with the discov- 
ery and description of this trans i tion ( Erdos and Renvil . 
Il959l : ISolomonoff and Rapoportl . Il95l[ ). Remarkably, it 
takes place in sparse networks, at {q) ^ const, which 
makes this range of mean degrees most interesting. 



A. Tree ansatz 



I. Small-world networks 

The small-wor ld networks introduced by 

IWatts and StrogaI3 (1991) are superpositions of fi- 
nite dimensional lattices and classical random graphs, 
thus combining their properties. One of variations 
of the Watts-Strogatz model is explained in Fig. (5) 
randomly chosen pairs of vertices in a one-dimensional 
lattice are connected by shortcuts. There is a smooth 
crossover from a lattice to a small-world geometry with 
an increasing number of shortcuts. Remarkably, even 
with extremely low relative numbers of shortcuts, these 
networks demonstrate the small-world phenomenon. 

iKleinberd (|l999l l2000l) used an important generaliza- 
tion of the Watts-Strogatz model. In the Kleinberg net- 
work ("the grid-based model with exponent a"), the 



The great majority of analytical results for cooperative 
models on complex networks were obtained in the frame- 
work of the tree approximation. This ansatz assumes 
the absence of finite loops in a network in the thermody- 
namic limit and allows only infinite loops. The allowance 
of the infinite loops is of primary importance since they 
greatly influence the critical behavior. Indeed, without 
loops, that is on perfect trees, the ferromagnetic order, 
say, in the Ising model occurs only at zero temperature. 
Also, the removal of even a vanishingly small fraction of 
vertices or edges from a perfect tree eliminates the giant 
connected component. 

The tree ansatz allows one to use the convenient tech- 
niques of the theory of random branching processes. On 
the other hand, in the framework of this ansatz, equilib- 
rium networks are actually equivalent to random Bethe 
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(a) 



(b) 



Q 



O _ O 



(c) 7-5 



FIG. 6 (a) The graphic notation for the probabihty x that, 
following a randomly chosen edge to one of its end vertices, 
we arrive at a finite connected component, (b) Equation ^ 
or, equivalently, Eq. (|10|l in graphic form, (c) The graphic 
representation of formula @ and of equivalent relation (|lip 
for the relative size S of the giant connected component. 



lattices. 



its random end; then x is the probability that after re- 
moving this edge, the chosen end vertex will belong to 
a finite connected component. A graphic representation 
of X is introduced in Fig. (Sfa). The probability that an 
edge belongs to one of finite components is, graphically. 



o- 



-0 = ^' 



(7) 



This is the probability that following an edge in any di- 
rection, we arrive at finite trees. Thus 1 — a;^ is a fraction 
of edges which are in the giant connected component. 
This simple relation enables us to measure x. Using fea- 
tures (i), (ii), and (iii) immediately leads to the following 
self-consistent equation for x and expression for the prob- 
ability 1 — S that a vertex belongs to a finite connected 
component: 



^ (q) ' 

q 

l-S = J2Piq)x'^. 



(8) 
(9) 



B. Organization of uncorrelated networks 

The mathematical solution of the problem of or- 
ganization of arbitrary uncorrelated networks as a 
system of conne c ted c o mpon ents was proposed by 
Mollov and R eedl (1 19951 . Il998l). In th e works of 
Newman et all (|200l[ ) and of lCallawav et all (2000) these 
ideas were represented and developed using the appara- 
tus and language of physics. Here we describe these fun- 
damental results and ideas i n simple terms. The r eader 
may refe r to th e papers of iNewman et all ( 200ll ) and 
iNewmanI ( 2003b[ ) for the details of this theory based on 
the generating function technique. 



1. Evolution of the giant connected component 

The theory of uncorrelated networks (we mostly dis- 
cuss the configuration model, which is completely de- 
scribed by the degree distribution P{q) and size N) is 
based on their following simplifying features: 

(i) The sole characteristic of a vertex in these net- 
works is its degree, in any other respect, the vertices 
are statistically equivalent — there are no borders or 
centers, or older or younger vertices in these mod- 
els. The same is valid for edges. 

(ii) The tree ansatz is supposed to be valid. 

(iii) Formulas ([1]) and ^ are valid (see Fig. [3]) . 

Feature (i) allows one to introduce the probability x 
that, following a randomly chosen edge to one of its end 
vertices, he or she arrives at a finite connected compo- 
nent. In more strict terms, choose a random edge; choose 



In particular, relation ([9]) is explained as follows. A ver- 
tex belongs to a finite connected component if and only 
if following every its edge in direction from this vertex we 
arrive at a finite tree. The probability of this event is x'' 
for a vertex of degree q. For a randomly chosen vertex, 
we must sum over q the products of x'' and the proba- 
bility P{q). One can see that S is the relative size of the 
giant connected component. Figures [SKb) and (c) present 
these formulas in graphic form and explain them. Note 
that if P{q = 0, 1) = 0, then Eq. ^ has the only solution 
X — 1, and so = 1, i.e., the giant connected component 
coincides with the network. Using the generating func- 
tion of the degree distribution, (j>(z) = J2q Pi^)^"^ ^^"^ 
the notation (j)i{z) = cf)' {z) / cf)' [1) = <l)'{z)/{q) gives 



X = 01 (x), 
5=1- (t>{x) 



(10) 
(11) 



These relations demonstrate the usefulness of the gener- 
ating function technique in network theory. The devia- 
tion 1 — 2: plays the role of the order parameter. If Eq. ([5]) 
has a non-trivial solution a; < 1, then the network has the 
giant connected component. The size of this component 
can be found by substituting the solution of Eqs. ([8|) or 
(fTU)l into formulas ^ or pTjl . Remarkably, the resulting 
S is obtained by only considering finite connected compo- 
nents [which are (almost) surely trees in these networks], 
see Fig. [6l Knowing the size of the giant connected com- 
ponent and the total number of finite components, one 
can find the number of loops in the giant component . 
For the calculation of this number, see lLee et "aLl ((2004cD . 
Applying generating function techniques in a similar way 
one may also describe the organization of connected com- 
ponents in the b ipartite uncorrelated networks, see, e.g., 
ISoderberd (|2002D . 
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The analysis of Eq. ([8]) shows that an uncorrelated 
network has a giant connected component when the mean 
number of second nearest neighbors of a randomly chosen 
vertex Z2 — {q^) — {q) exceeds the mean number of nearest 



neighbors: Z2 > zi. 



This is the Molloy-Reed criterion: 
(q^) - 2(q) > (12) 



(iMollov and Reedl . I1995D . ^or the Poisson degree distri- 
bution, i.e., for the classical random graphs, Z2 = (9)^, 
and so the birth point of the giant connected component 
is zi = 1. In the Gilbert model, this corresponds to 
the critical probability Pc{N 00) = 1/A^ that a pair 
vertices is connected. These relations explain the impor- 
tance of the sparse network regime, where this transition 
takes place. The Molloy-Reed criterion shows that the 
divergence of the second moment of the degree distri- 
bution guarantees the presence of the giant connected 
component. 

Exactly at the birth point of the giant connected com- 
ponent, the mean size of a finite component to which a 
randomly chosen vertex belongs diverges as follows: 



2{q) - (q2 



1 



(13) 



iNewman et aJ\ (120011 ). This formula is given for the 
phase without the giant connected component. In this 
problem, (s) plays the role of susceptibility. Usually, it is 
convenient to express the variation of the giant compo- 
nent near the critical point and other critical properties 
in terms of the deviation of one parameter, e.g., the mean 
degree (g), from its critical value, (q)c- Usually, the re- 
sulting singularities in terms of (q) — {q)c are the same as 
in terms of p — pc in the percolation problem on complex 
networks (p is the concentration of undeleted vertices, 
see below). Note that in scale-free networks with fixed 
exponent 7 one may vary the mean degree by changing 
the low degree part of a degree distribution. 



2. Percolation on uncorrelated networks 

What happens with a network if a random fraction 
1 — p of its vertices (or edges) are removed? In this site 
(or bond) percolation problem, the giant connected com- 
ponent plays the role of the percolation cluster which 
may be destroyed by decreasing p. Two equivalent ap- 
proaches to this pr oblem are possible. The first way 
(ICohen et all |2000D uses the following idea, (i) Find 
the degree distribution of the damaged network, which 
is P{q) = P{r)Clp'ii\ -pY"^ both for the site and 

bond percolation, (ii) Since the damaged network is ob- 
viously still uncorrelated, Eqs. ([5]) and ^ with this P{q) 
describe the percolation. 

The second way is technically more convenient: de- 
rive direct generalizations of Eqs. ((S]) and (O with the 



parameter p and the degr ee distribution P(q) of the orig- 
inal, undamaged network ( Callawav et aLl . [200Q) . Simple 



Y< 3 / / 




/3< Y <4 / 


/ Y >4 



FIG. 7 The effect of the heavy-tailed architecture of a net- 
work on the variation of its giant connected component under 
random damage. The relative size of the giant connected com- 
ponent, S, is shown as a function of the concentration p of 
the retained vertices in the infinite network. 



arguments, similar to those illustrated by Fig. [SI imme- 
diately lead to 

x = l-p + p^^.'-\ (14) 
I- S =\-p + p^P{q)x'i. (15) 



Although Eq. is valid for both the site and bond 

percolation, relation ([T5]) is valid only for site percolation. 
For the bond percolation problem, use Eq. ([9]). One can 
see that the giant connected component is present when 



pZ2 > Zi, 

that is, the percolation threshold is at 

{1) 



Pc 



^2 {q^)-{qy 



(16) 



(17) 



So, in particular, pc = f/{q) for classical random graphs, 
and Pc ~ l/{q — 1) for random regular graphs. Rela- 
tions and P7|) show that it is practically impossible 
to eliminate the giant connected component in an in- 
finite uncorrelated network if the second moment of its 
degree distribution diverges — the net work is ultraresilient 
against random da mage or failures ( Albert et al\ . I2OOOI : 
ICohen et all |2000D . In scale-free netwo rks, this takes 
place if 7 < 3. ICallawav et al. I (|2000D considered a 



more general problem, where the probability p{q) that 
a vertex is removed depends on its degree. As is 
natural, the removal of highly connected hubs from a 
scale-free network — an intentional damage — effectively 
destroys its giant connected component (Albert et al\, 
I2OOOI: ICohen aLl . l200lh . 

Near the critical point, the right hand side of Eq. ([M]) 
for the order parameter 1 — a; becomes non-analytic if the 
higher moments of the degree distribution diverge. This 
leads to unusual critical singularities in these percolation 
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problems and, more generally, to unusual critical phe- 
nomena at the birth point of the giant connected compo- 
nent in networks with hea vy-tailed degree distributions 
( Cohen et "oil. I2OO2I [2003a). ^'or the sake of convenience, 
let the infinite uncorrelated network be scale-free. In this 
case, the critical behavior of th e size S of the giant con- 
nected component is as follows (jCohen et a/.l . l2002t) : 



(i) if 7 > 4, i.e., {q'^) < 00, then S oc p—pc, which is the 
standard mean- field result, also valid for classical 
random graphs; 

(ii) if 3 < 7 < 4, then S (x {p - pc)'^/^'^-^\ i.e., the /3 
exponent equals 1/(7 — 3); 

(iii) if 7 = 3, then Pc — and S cc p exp[— 2/(p(q))]; 

(iv) if 2 < 7 < 3, then pc = and 5 cx pi/(3-7). 

These results are schematically shown in Fig. [71 We 
stress that the unusual critical exponents here are only 
the consequence of a fat-tailed degree distribution, and 
the theory is essentially of mean-field nature. Note that 
we discuss only unweighted networks, where edges have 
unit weights. For percolation on weighted networks, see 
iBraunstein et all (|2003al . l2004l ): iLi et al\ (|2007[) and ref- 
erences therein. In weighted networks one can naturally 
introduce a mean length of the path along edges with the 
minimum sum of weights, ?opt- Based on the percolation 
theory Braunstein et at showed that in the Erdos-Renyi 
graphs with a wide weight distribution, the optimal path 
length £opt - 

Numerous variations of percolation on networks may 
be considered. In particular, one may remove vertices 
from a network wi th a degree-de penden t probability 
(I Albert et all l2000t ICallawav et~d\ . l2000t iGallos et all 
I2OO5D . 

The probability that a vertex of degree q belongs to 
the giant connected component is 1 — x'' [compare with 
Eq so that it is high for highly connected vertices. 
Here x is the physical root of Eq. ([8]) for the order pa- 
rameter. The degree distribution of vertices in the giant 
connected component (GCC) is 



P< 



GCC 



(9) 



P{q){l-X'l) 



(18) 



Therefore at the birth point (x^l) of the giant connected 
component, the degree distribution of its vertices is pro- 
portional to qP{q). Thus, in networks with slowly de- 
creasing degree distributions, the giant connected com- 
ponent near its birth point mostly consists of vertices 
w ith high degr e es. 

ICohen et a/1 (|200lL ^oM) found that at the birth 
point, the giant connected component does not have a 
small- world geometry (that is, with a diameter growing 
with the number of vertices N slower than any positive 
power of N) but a fractal one. Its fractal dimension — a 
chemical dimension di in their notations — equals di{"f > 
4) = 2 and di{3 < 7 < 4) = (7 - 2)/(7 - 3). That 



is, the mean intervertex distance in the giant connected 
component (of size n) at the point of its disappearance 
is quite large, £ ~ rt*^' . To be clear, suppose that we are 
destroying a small world by deleting its vertices. Then 
precisely at the moment of destruction, a tiny remnant of 
the network has a much greater diameter than the origi- 
nal compact network. It is important that this remnant is 
an equilibrium tree with a degree distribution character- 
ized by exponent 7 — 1. Indeed, recall that in Sec. III. Cl we 
indicated that equilibrium connected trees have a fractal 
structure. So substituting 7 — 1 for 7 in the expression 
for the fractal dime nsion of equilibrium connected trees 
Burda et all (|200ll ). see Sec. lII.C| . we readily explain the 



form of di{'y). 



3. Statistics of finite connected components 

The sizes of largest connected components s'*-* depend 
on the number of vertices in a network, N. Here the 
index z = 1 is for the largest component, i = 2 is for 
the second largest component, and so on. In the classical 
random graphs, s^^\N) with a fixed i and N ^ 00 are 
as follows (for mor e detail see the graph theory papers of 
iBorgs et all (|200ll ) and of iBollobas and RiordanI (|2003l )l: 



(i) for p < pc{l - CN-^/^), s('^i)(7V) - InA^; 

(ii) within the so called scaling window |p — Pc| < 
CN-^'\ s(^>i)(iV)^Ar2/3. 

(iii) for p > pril + CN-'^ /^), s^^'>{N)^N, s(*>i)(iV) - 
IniV (lBollobasLfl98l . 



Here C denotes corresponding constants and p ~ {q)/N. 

In Sec. IIX.B] we will present a general phenomenolog- 
ical approach to finite-size scaling in complex networks. 
The application of this approach to scale-free networks 
with degree distribution exponent 7 allows one to de- 
scribe the sizes of the largest connected components: 

(i) if 7 > 4, the same formulas hold, as for the classical 
random graphs; 



(ii) 



if 3 < 7 < 4, then s('^i)(iV) - Ar(7-2)/(7-i) within 
the scaling window \p - Pel < C7V-('>'-3)/(')'-i) 
(iKaliskv and Cohenl . I2006D . and the classical re- 
sults, represented above, hold outside of the scaling 
window. 



Similarly, one can write 

Pc{N = c5o) - pc{N) - iV-(T-3)/(T-i) (19) 

for the deviation of the percolation threshold in the range 
3 < 7 < 4. (Note that rigorously speaking, pc is well 
defined only in the N ^ 00 limit.) We will discuss the 
size effect in networks with 2 < 7 < 3 in Sec. IIII.B.4I 

Let us compare these results with the corresponding 
formulas for the standard percolation on lattices. If the 
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dimension of a lattice is below the upper critical dimen- 
sion for the percolation problem, d < — 6, then 



(20) 



within the scaling window |p— Pel < const N~^^^'^'^\ Here 
df = {d +2 — r])/2 = P/i/ + 2 — f] is the fractal dimension 
of the percolation cluster in the critical point measured 
in the d-dimensional space by using a box counting pro- 
cedure, v is the correlation length exponent, and rj is the 
Fisher exponent. (The boxes in this box counting pro- 
cedure are based on an original, undamaged network.) 
Above the upper critical dimension, which is the case for 
the small worlds, one must replace, as is usual, d in these 
formulas (and in scaling relations) by c?„ and substitute 
the mean-field values of the critical exponents v, rj, and (3. 
Namely, use v = 1/2 and ry = 0. For network s, the mean- 
field ex ponent /3 = /3(7), and so, similarly to lHong et al\ 
we may formally introduce the upper critical di- 
mension du{'^) = 2(3/i/ + 2 — rj = 4/3(7) -I- 2 ^-^d the fractal 
dimension df {j) = (3/i^ + 2 - 77 = 2/3(7) + 2. 

With the known order parameter exponent /3(7) from 
Sec. IIII.B.2I this heuristic approach gives the fractal di- 



mension 



dfij > 4) = 4 and d/(3 < 7 < 4) = 2- 



(21) 



( Cohen et m. l2008a[ ). Mote that this fractal dimension 
df does not coincide with the "chemical dimension" di 
discussed above but rather df — 2di. Similarly, 



duh > 4) = 6 and d„(3 < 7 < 4) = 2 



7-1 



(22) 



(ICohen et all l2003al : iHong et all l2007at IWu et all 
l2007a ). With these ^^(7) and dj(pi), we reproduce the 
above formulas for finite-size networks. 

The distribution of sizes of connected components in 
the configuration model was derived by using the gener- 
ating function technique ( Newmaiil . 120071 : iNewman et all 
[200 li ). Let -P(s) be the size distribution of a finite com- 
ponent to which a randomly chosen vertex belongs and 
Q(s) be the distribution of the total number of vertices 
reachable following a randomly chosen edge. h{z) = 
^^7^(5)0" and hi{z) = J2s corresponding 
generating functions. Then 



hiz) = Z(/)(/ii(z)), 
hi{z) = Z(/)i(ft,i(z)) 



(23) 
(24) 



( Newman et al ]. |2001[) . To get h{z) and its inverse trans- 
formation ■p(s), one should substitute the solution of 
Eq. ([24]) into relation ((23|l . 

Equations (^5]) . ([M]) have an interesting consequence 
for scale-free networks without a giant connected compo- 
nent. If the degree distribution exponent is 7 > 3, then 
in this situation the size distribution P(s) is a l so asy mp- 
totically power-law, 'P(s) - s'^t-i) (|Newmanl . [2Ci07n . To 



arrive at this result, one must recall that if a function is 
power-law, P{k) ^ k^'^ , then its generating function near 
z = 1 is (f){z) — a{z) + C(l — z)'^^^, where a{z) is some 
function, analytic at z = 1 and C is a constant. Substi- 
tuting this <j){z) into Eqs. ((23l) and ((24)) immediately re- 
sults in the nonanalytic contribution ^ (1 — z)'''^^ to h(z). 
[One must also take into account that h{l) = /ii(l) = 1 
when a giant component is absent.] This corresponds to 
the power-law asymptotics of V{s). Remarkably, there 
is a qualitative difference in the component size distri- 
bution between undamaged networks and networks with 
randomly removed vertices or edges. In percolation prob- 
lems for arbitrary uncorrelated networks, the power law 
for the distribution P{s) fails everywhere except a per- 
colation threshold (see below). 

In uncorrelated scale-free networks without a giant 
connected component, the large st conne c ted component 
conta ins ~ N'^/h-^) vertices ( Durrettl . 120061 : iJansonl . 
I2007D . where we assume 7 > 3. As is natural, this size 
coincides with the cutoff kcut{N) in these networks. 

Near the critical point in uncorrelated scale-free net- 
works with a giant connected component, the size dis- 
tribution of finite connected components to which a ran- 
domly chosen vertex belongs is 



Vis) 



-r+l 



-s/s*(p) 



(25) 



where s*ipc)—>oo: s*ip) ^ (p ~ Pc) ^^'^ near pc 



( Newman et a/.l , |200lh . The distribution of the sizes of 
finite connected components is Vs{s) ~ 7^(s) /s. In uncor- 
related networks with rapidly decreasing degree distribu- 
tions, relation (P5)) is also valid in the absence of a giant 
connected component. Note that this situation, in partic- 
ular, includes randomly damaged scale- free networks — 
percolation. The distribution V{s) near critical point in 
undamaged scale-free networks without a giant compo- 
nent, in simple terms, looks as follows: V{s) ~ s 



-r + l 



at sufficiently small s, and V{s) ^ s 



-7-1-1 



at sufficiently 



large s (7 > 3, in this region the inequality 7 > r is 
valid). Exponents r, cr, and /3 satisfy the scaling rela- 
tions T — 1 = (t/3 + 1 = adu/2 ~ d^/df. We stress that 
the mean size of a finite connected component, i.e., the 
first moment of the distribution Ps(s), is finite at the 
critical point. A divergent quantity (and an analogue 
of susceptibility) is the mean size of a finite connected 
component to which a randomly chosen vertex belongs. 



J2sVis)^\p 



Pel 



(26) 



where 7 is the "susceptibility" critical exponent. This 
exponent does not depend on the form of the degree 
distribution. Indeed, the well-known scaling relation 
•y /u = 2 — rj with 1/ = 1/2 and 77 = substituted leads to 
7=1 within the entire region 7 > 3. 

The resulting exponents for finite connected compo- 
nents in the scale-free configuration model are as follows: 

(i) for 7 > 4, the exponents are r = 5/2, a = 1/2, 7 = 
1, which is also valid for classical random graphs; 
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ii) for 3 < 7<4,r = 2 + 1/(7- 21, a = {-f - 3) / {-f - 2) 



7 ^ 



1 (|Cohen et all l2003al) 



The situation in the range 2 < 7 < 3 is not so clear. 
The difhculty is that in this interesting region, the giant 
connected component disappears at p = 0, i.e., only with 
disappearance of the network itself. Consequently, one 
cannot separate "critical" and non-critical contributions, 
and so scaling relations fail. In this range, 



(iii) i.e., for 2 < 7 < 3, (s) oc p, r = 3, <t = 3 — 



7- 



Note that the last two values imply a specific cutoff of 
the degree distribution, namely gcut ~ N^^^. 

In principle, the statistics of connected components 
in the bond percolation problem for a network may be 
obtained by analysing the solution of the p-s tate Potts 
model (Sec. IVIip with p—1 placed on this net. iLee et al\ 
(l2004cD realized this approach for the static model. 

The correlation volume of a vertex is defined as 



V,, 



(27) 



1=0 



where zt is the number of the f-th nearest neighbors of 
vertex z, and 6 is a parameter characterizing the decay 
of correlations. The parameter h may be calculated for 
specific cooperative models and depends on their control 
parameters. Sec. IVI.C.4I In particular, if h=l, the corre- 
lation volume is reduced to the size of a connected com- 
ponent. Let us estimate the mean correlation volume in 
uncorrelated network with the mean branching coefhcient 
B = Z2/ zi. V ~ J^ei^^y assume that the network 
has the giant connected component). So V{N 00) di- 
verges at and above the critical value of the parameter, 

= 1/B. At the critical point, V{bc) = 1 1^^- 
Since - N, we obtain V - N^n{bB)/\nB f^j. ^ > 

Thus, as b increases from be to 1, the exponent of the 
correlation volume grows from to 1. 

The correlation volume takes into account remote 
neighbors with exponentially decreasing (if < 1) 
weights. A somewhat related quantity — the mean num- 
ber vertices at a distance less tha n aI(N) from a ver tex, 
where a > 1, — was analysed bv iLopez et al\ ( 2007f ) in 
their study of "limited path percolation" . This number 
is of the order of , where exponent 6 — S{a, B) < 1. 



4. Finite size effects 

Practically all real-world networks are small, which 
makes the factor of finite size of paramount importance. 
For example, empirically studied metabolic networks 
contain about 10"^ vertices. Even the largest artificial 
net — the World Wide Web, whose size will soon approach 
10^^ Web pages, show qua li tatively strong finite size 
effects jBo guna et all 12004 iDorogovtsev and MendesI , 
I2OO2I : iMav and LlovdI . l200lh . To understand the strong 
effect of finite size in real scale-free networks one must 



recall that exponent 7 < 3 in most of them, that is the 
second moment of a degree distribution diverges in the 
infinite network limit. 

Note that the tree ansatz may be used even in this re- 
gion (7 < 3), where the uncorrelated networks are loopy. 
The same is true for at least the great majority of inter- 
acting systems on these networks. The reason for this 
surprising applicability is not clear up to now. 

Let us demonstrate a poor-man's approach to percola- 
tion on a finite size (uncorrelated) network with 7 < 3, 
where Pc{N 00) 0. To be specific, let us, for exam- 
ple, find the size dependence of the percolation thresh- 
old, pc{N). The idea of this estimate is quite simple. 
Use Eq. (fT7|) . which was derived for an infinite network, 
but with the finite network's degree distribution substi- 
tuted. Then, if the cutoff of the degree distribution is 
qcut N^^'^, we readily arrive at the following results: 

Pc(iV,2<7<3) - 7V^(3"'^)/2 p^(Ar,^^3)^i/lniV. (28) 

These relations suggest the emergence of the notice- 
able percolation thresholds even in surprisingly large net- 
works. In other words, the ultraresilience against random 
failures is effectively broken in finite networks. 

Calculations of other quantities for percolation (and 
for a wide circle of cooperative models) on finite nets 
are analogous. Physicists, unlike mathematicians, rou- 
tinely apply estimates of this sort to various problems 
defined on networks. Usually, these intuitive estimates 
work but evidently demand thorough verification. Unfor- 
tunately, a strict statistical mechanics theory of finite size 
effects for networks is technically hard and was developed 
only for very special models (see Sec. lIV.Ap . For a phe- 
nomcnological approach to this problem, see Sec. IIX.BI 



5. fc-core architecture of networks 



The A:-core of a network is its l argest subgraph 



IS Its l argest su b grapn 
whose vertices have degree at least k (|BollobasL flQSl 
IChaluoa et d\ . I1979D . In other words, each of vertices 
in the k-core has at least k nearest neighbors within this 
subgraph. The notion of the fc-core naturally generalizes 
the giant connected component and offers a more com- 
prehensive view of the network organization. The fc-core 
of a graph may be obtained by the "pruning algorithm" 
which looks as follows (see Fig. Remove from the 
graph all vertices of degrees less than fc. Some of re- 
maining vertices may now have less than k edges. Prune 
these vertices, and so on until no further pruning is pos- 
sible. The result, if it exists, is the fc-core. Thus, a net- 
work is hierarchically organized as a set of successfully 
enclosed fc-cores, similarly t o a Russi an nesting doll — 
"matrioshka" . Alvarcz-Ha melin et al ] llooe) used this 
fc-core architecture to produce a set of beautiful visual- 
izations of diverse networks. 

The k-core (bootstrap) percolation implies the break- 
down of the giant fc-core at a threshold concentration 
of vertices or edges removed at random from an infinite 
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3-core 




FIG. 8 Construction of the 3-core of a given graph. First we 
remove vertices 1, 2 and 4 together with their links because 
they have degrees smaller than 3. In the obtained graph, 
vertex 3 has degree 1. Removing it, we get the 3-core of the 
graph. 



network. iPittel et all (|l996D found the way to analyti- 
cally describe the fc-core ar chitecture of classical random 
graph s. More recently, iFernholz and Ramachandranl 
( 20041 ) mathematically proved that the fc-core organiza- 
tion of the configuration model is asymptotically exactly 
described in the framework of a simple tree ansatz. 

Let us discuss the fc-core percolation in the con- 
figuration model with degree distribution P{q) by 
using intuitive arguments based on the tree ansatz 
(|Dorogovtsev et a/.l . l2006"al lbl: iGoltsev et all 120061 ). The 



validity of the tree ansatz here is non-trivial since in this 
theory it is applied to a giant fc-core which has loops. 
Note that in tree- like networks, (fc>3)-cores (if they ex- 
ist) are giant — finite (fc>3)-cores are impossible. In con- 
trast to the giant connected component problem, the tree 
ansatz in application to higher fc-cores fails far from the 
fc-core birth points. We assume that a vertex in the net- 
work is present with probability p ^ 1 — Q. In this locally 
tree-like network, the giant fc-core coincides with the in- 
finite (fc— l)-ary subtree. By definition, the m-ary tree is 
a tree where all vertices have branching at least m. 

Let the order parameter in the problem, R, be the 
probability that a given end of an edge of a network is 
not the root of an infinite (fc— l)-ary subtree. (Of course, 
R depends on fc.) An edge is in the fc-core if both ends of 
this edge are roots of infinite (fc— l)-ary subtrees, which 
happens with the probability (1 — R)^. In other words. 



number of edges in the fc-core 
number of edges in the network ' 



(29) 



which expresses the order parameter R in terms of ob- 
servables. Figure [5] graphically explains this and the fol- 
lowing two relations. A vertex is in the fc-core if at least 
fc of its neighbors are roots of infinite (fc— l)-ary trees. 
So, the probability Mk that a random vertex belongs to 
the fc-core (the relative size of the fc-core) is given by the 
equation: 



(30) 



n>k q>n 



where C^^ — q\/[{q — n)!n!]. To obtain the relative size of 
the fc-core, one must substitute the physical solution of 
the equation for the order parameter into Eq. ([50]) . We 
write the equation for the order parameter, noticing that 



R 1-R 
(a) 1 CO 



(b) 



(c) V 



OO CO 




Cd) CO = pY^ 



>k-l 



FIG. 9 Diagrammatic representation of Eqs. (|29p - (|31|l . (a) 
Graphic notations for the order parameter R and for 1 — R. 
(b) The probability that both ends of an edge are in the fc- 
core, Eq. (I29|l . (c) Configurations contributing to Mk, which 
is the probability that a vertex is in the fc-core, Eq. (|3Up . The 
symbol V here indicates that there may be any number of the 
nearest neighbors which are not trees of infinite (fc — l)-ary 
subtrees, (d) A graphic repres entation of Eg. (I3ip for the 
order parameter. Adapted from iGoltsev et ~al\ (|2006l ). 



a given end of an edge is a root of an infinite (fc— l)-ary 
subtree if it has at least fc — 1 children which are roots of 
infinite (fc— l)-ary subtrees. Therefore, 



1-R^p 



n—k—1 



OO 

E 



{i+i)p{i+i) 



Zl 



C;i?*-"(l-i?)". (31) 



This equation strongly differs from that for the or- 
der parameter in the ordinary percolation, compare with 
Eq. (HH). The solution of Eq. at fc>3 indicates a 
quite unusual critical phenomenon. The order parame- 
ter (and also the size of the fc-core) has a jump at the 
critical point like a first order phase transition. On the 
other hand, it has a square root critical singularity: 



Rc-R<^[p- Pc(fc)]'/' cx Mk - Mkc 



(32) 



see Fig. 1101 This intriguing criti cal phenomenon is often 
called a hybrid phase transition (iParisi and Rizzol . 120061 : 
ISchwartz etai\ . l2006l ). Relations Ij32p are valid if the 
second moment of the degree distribution is finite. Oth- 
erwise, the picture is very similar to what we observed 
for ordinary percolation. In this range, the fc-cores, even 
of high order, practically cannot be destroyed by the ran- 
dom removal of vertices from an infinite network. 

The 2-core of a graph can be obtained from the giant 
connected component of this graph by pruning dangling 
branches. At fc = 2, Eq. ((3T|) for the order parameter is 
identical to Eq. for the ordinary percolation. There- 
fore the birth point of the 2-core coincides with that of 
the giant connected component, and the phase transition 
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FIG. 11 3-core of a graph and its corona (removed vertices 
and links are not shown). The corona consists of a set of 
clusters with vertices (open circles) having exactly 3 nearest 
neighbors in this 3-core. 



FIG. 10 Relative sizes of the fc-cores, M^, in classical random 
graphs with the mean degree zi — 10 versus the concentra- 
tion Q = 1 — p of random ly removed vertices. Adapted from 
iDorogovtsev et al\ l|2006al 'l. 



is continuous. According to Eq. (l30l) the size M2 of the 
2-core is proportional to (1 — i?)^ near the critical point, 
and so it is proportional to the square of the size of the 
giant connected component. This gives M2 oc (p ~ Pc)'^ 
if the degree distribution decays rapidly. 

In stark contrast to ordinary percolation, the birth 
of (fc>2)-cores is not related to the divergence of corre- 
sponding finite components which are absent in tree-like 
networks. Then, is there any divergence associated with 
this hybrid transition? The answer is yes. To unravel the 
nature of this divergence, let us introduce a new notion. 
The k-core's corona is a subset of vertices in the fc-core 
(with their edges) which have exactly k nearest neigh- 
bors in the fc-core, i.e., the minimum possible number of 
connections. One may see that the corona itself is a set 
of disconnected clusters. Let Ncm be the mean total size 
of corona clusters attached to a vertex in the fc-core. It 
turns out that it is iVcrn(p) which diverges at the birth 
point of the fc-core. 



Ncrnip) OC [p-pcik)] 



-1/2 



(33) 



( Goltsev et al 1 120061 : ISchwartz et dl . I2006D . Moreover, 
the mean intervertex distance in t he corona clus t ers d i- 
verges by the same law as Ncmip) (|Goltsev et al liooi). 
It looks like the corona clusters "merge together" exactly 
at the fc-core percolation threshold and simultaneously 
disappear together with the fc-core, which, of course, does 
not exist ai p > Pc{k). 

Similarly to the mean size of a cluster to which a 
vertex belongs in ordinary percolation, A^nm plays the 
role o f susceptibility in this problem, see ISchwartz et oil 
(I2OO6I) : br more detail. The exponent of the singularity 
in Eq. ([BS]) . 1/2, dramatically differs from the standard 
mean- field value of exponent 7 = 1 (see Sec. IIII.B.3|) . 
At this point, it is appropriate to mention a useful as- 
sociation. Recall the temperature dependence of the or- 
der parameter m{T) in a first order phase transition. In 
normal thermodynamics, metastable states cannot be re- 
alized. Nonetheless, consider the metastable branch of 
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FIG. 12 Relative size of the fc-cores vs. k in several networks. 
Oi Mk calculated neglecting correlations, by using the degree 
distribution of I nternet r outer network, A'^ ft; 190 000, adapted 
from Doroaovt sev et al\ (|2006a). A, measurements for the 
Autonomous System network (CAIDA ma p), N — 8542, 
adapted from I Alvarez- Hamelin et~al\ (|2005bl '). •, results for a 
maximally random scale-free (7=2.5) network of 10^ vertices, 
and ■, for a similar networ k but with a given st r ong clu ster- 
ing, C=0.71, adapted from lSerrano and Bogunal (|2006al '). 



m{T). One may easily find that near the end (Tq) of 
this branch, m{T) = to(To) + const[To - TJ^/^, and the 
susceptibility xi^) [To ~ T\~^l'^ . Compare these sin- 
gularities with those of Eqs. |32)) and p3|) . The only 
essential difference is that, in contrast to the fc-core per- 
colation, in the ordinary thermodynamics this region is 
not appro achable. Parallels of this kind w ere discussed 
already bv lAizenman and Lebowitd 



By using Eqs. ([5U)) and (PT|) . we can easily find the 
fc-core sizes, in the important range 2 < 7 < 3: 



Mk=p 



= „l/(3-7) 



(go/fc) 



(7-1)7(3-7) 



(34) 



where 90 is t he minimal degree in the scale-free degree 
distribution ( Dorogovtsev et all . l2006al ) . The exponent 
of this power law agrees with the observed one in a real- 
world network — the Internet at the Autonomous Sys- 
tem level and the map of routers (lAlvarez- Hamelin et aZI . 
l2005bl : [CaTmi et a/.l . [2006bl : lKirkDatrickll2005l ). In the in- 
finite scale-free networks of this kind, there is an infinite 
sequence of the fc-cores ([Ml) . All these cores have a prac- 
tically identical architecture — their degree distributions 
asymptotically coincide with the degree distribution of 
the network in the range of high degrees. 

The finiteness of networks restricts the fc-core sequence 
by some maximum number for the highest fc-core. 
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iGoltsev et all ( 2006t) and iDorogovtsev et al\ (|2006allbh 
estimated kh substituting empirical degree distributions 
into the equations for uncorrelated networks. Unfortu- 
nately, the resulting kh turned o ut to be several (3) times 



Equation ((35)) shows that the birth of the giant con- 
nected component is a continuous phase transition. The 
percolation threshold is found by linearizing Eq. (P5|) 



smalle r than the obs e rved v alues (lAlvarez-Hamelin et al. 
I20n5b : JCarmi et al\ . [2Q03)- Later ISerrano and Bogundl 
(|2006al ldr arrived at much more realistic kh, taking into 
account high clustering (see Fig. [T^ . (They simulated a 
maximally random network with a given degree distribu- 
tion and a given clustering.) There is also another way to 
diminish kh '■ random damaging first destroys the highest 
/c-core, then the second highest, and so on. 



C. Percolation on degree-degree correlated networks 

Let in a random network only pair correlations be- 
tween nearest neighbor degrees be present. Then 
this network has a locally tree-like structure, and so 
one can easil y analyse the organiz a tion of connected 
components (IBoguiia et all . l2003bl : iNewmanl . l2002bl : 
IVazguez and Morenol 20031 ). The network is completely 
described by the joint degree-degree distribution P{q, q'), 
see Sec. IILFI (and, of course, by N). It is convenient to 
use a conditional probability P{q'\q) that if an end vertex 
of an edge has degree q, then the second end has degree 
q'. In uncorrelated networks, P{q'\q) = q'P{q')/(q) is in- 
dependent of g. Obviously, P{q'\q) — {q)P{q,q')/[qP{q)]. 
The important quantity in this problem is the probabil- 
ity Xq that if an edge is attached to a vertex of degree q, 
then, following this edge to its second end, we will not 
appear in the giant connected component. For the sake 
of brevity, let us discuss only the site percolation prob- 
lem, where p is the probability that a vertex is retained. 
For this problem, equations for Xq and an expression for 
the relative size of the giant connected component take 
the following form: 



Xq = l-p + p'^P{q'\q){x. 
q' 

i~s = i-p+pj2pi<i)i^ 



(35) 



(36) 



(jVazguez and Morenol |2003[ ). which naturally general- 
izes Eqs. (dH) and (fT5|) . Solving the system of equa- 
tions ([55)1 gives the full set {x o |. Su bstituting {xq} into 



Eq. dSS]) provides S. [N ewmani (|2002b ) originally derived 
these equations in a more formal way, using generating 
functions, and numerically solved them for various net- 
works. The resulting curve S{p) was found to signifi- 
cantly depend on the type of correlations — whether the 
degree-degree correlations were assortative or disassor- 
tative. Compared to an uncorrelated network with the 
same degree distribution, the assortative correlations in- 
crease the resilience of a network against random dam- 
age, while the disas s ortati ve correlations diminish this 
resilience. See iNohl (I2007D for a similar observation in 
another network model with correlations. 



for small yq = 1 — Xq, which results in the condition: 
Sij' Cqq'Uq' = 0> whcrc the matrix elements Cqqi — 
—5qq' + p{q' — ^)P{q'\q)- With this matrix, the gener- 
alization of the MoUoy Reed criterion to the correlated 
networks is the following condition: if the largest eigen- 
value of the matrix Cqqi is positive, then the correlated 
network has a giant connected component. The percola- 
tion threshold may be obtained by equating the largest 
eigenvalue of this matrix to zero. In uncorrelated net- 
works this reduces to criterion ()17p . 

Interestingly, the condition of ultra-resilience against 
random damage does not depend on correlations. As 
in uncorrelated networks, if the second moment (g^) di- 
verges in an infinite network, the giant connected com- 
pone nt cannot be el iminate d by random removal of ver- 
tices ( Boguha et a/.l . ,2003b.: vizauez and Morenol 12003.) . 
Very simple calculations show that the mean number Z2 
of the second nearest neighbors of a vertex in a degree- 
degree correlated network diverges simultaneously with 
(q^). It is this divergence of Z2 that guarantees the ultra- 
resilience. 

Percolation and optimal shortest path problems were 
also stu died for weight ed networks with correlated 
weights (|Wu et allboOlsj) . 



D. The role of clustering 

The statistics of connected components in highly clus- 
tered networks, with numerous triangles (i.e., the clus- 
tering coefficient C does not approach zero as N—^oo), 
is a difficult and poorly studied problem. An important 
step to the resolution of this problem has been made by 
ISerrano and Bogufial ( 2006allbl l3) . These authors studied 
constructions of networks with given degree distributions 
and given mean clusterings of vertices of degree q, C{q). 
It turns out that only if C{q) < l/{q — 1), it is possi- 
ble to build an uncorrelated network with a given pair 
of characteristics: P{q) and C{q). Since clustering of 
this kind does not induce degree-degree correlations, the 
regime C{q) < l/{q—l) was conventionally called "weak 
clustering". (When C{q) < l/{q— 1), then the num- 
ber of triangles based on an edge in the network is one or 
zero.) On the other hand, \iC(q) is higher than \/{q — l) 
at least at some degrees — "strong clustering", — then the 
constructed networks necessarily have at least correla- 
ti ons between the degrees of th e nearest neighbors. 

ISerrano and Boguiial ( 2006al lblR) made a helpful sim- 
plifying assumption that the triangles in a network can- 
not have joint edges and neglected long loops. This as- 
sumption allowed them to effectively use a variation of 
the "tree ansatz". In particular they studied the bond 
percolation problem for these networks. The conclusions 
of this work are as follows: 

(i) If the second moment of the degree distribution 
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FIG. 13 Bond percolation on unclustered, and "strongly" 
and "weakly" clustered scale-free networks. Exponent 7 — 
3.5. The relative size S of the giant connected component is 
shown as a f unction of the concent r ation Q = 1 — p of removed 
edges. From lSerrano arid" Boeunal |20063). 



is finite, the "weak clustering" makes the network 
less resilient to random damage — the percolation 
threshold (in terms of Q — I — p, where Q is the 
fraction of removed edges) decreases, see Fig. [T31 
Contrastingly, the "strong clustering" moves the 
percolation threshold in the opposite direction, al- 
though small damage (low Q) noticeably diminishes 
the giant connected component. 

(ii) If the second moment of the degree distribution di- 
verges, neither "weak" nor "strong" clustering can 
destroy the giant connected component in an infi- 
nite network. 



iNewmanI ( 2003bl ) proposed a different approach to 
highly clustered networks. He used the fact that a one- 
mode projection of a bipartite uncorrelated network has 
high clustering, while the original bipartite network has 
a locally tree-like structure. (In this projection, two ver- 
tices of, say, type 1, are the nearest neighbors if they 
have at least one joint vertex of type 2.) This convenient 
feature allows one to describe properties of the clustered 
one-partite network with a tunable clustering and a tun- 
able degree distribution by applying the tree ansatz to 
the bipartite network. For details — a pplications to per - 
colation and epidemic processes, — see iNewmanI ( 2003bf ). 



E. Giant component in directed networks 

The structure of the giant connected component 
in u ncorrelated directed networks was studied by 
iDorog ovtscv et al. (2001a). By definition, edges of di- 
rected networks are directed, so that the configuration 
model is described by the joint in-, out-degree distribu- 
tion P{qi,qo). Directed networks have a far more com- 
plex organization and topology of the giant connected 
components than undirected ones. This organization 



may include specifically interconnected giant subcom- 
ponents with different birth points. Applying the tree 
ansatz, these authors found the birth points of various 
giant components and ob tained their s izes f or an arbi- 
trary P{qi, Qo), see also iSchwartz et oil ( 2002() . For more 
detailed desc ription of the giant components in directed 
n etworks se e 'Serrano and D e Los RiosI ( 2003) ■ 

lBogufia"an d Serrano (200^ generalized this theory to 
uncorrelated networks which contain both directed and 
undirected connections. These networks are character- 
ized by a distribution P{q, qi, qo), where q, qi, and qo are 
the numbers of undirected, in-directed, and out-directed 
connections of a vertex, respectively. 

The exponents of the critical singularities for the tran- 
sitions of the birth of various giant connec ted components 
i n dir ected networks were calculated by ISchwartz et all 
(I2002D . Sfote that although the in-, out-degrees of differ- 
ent vertices in these networks are uncorrelated, there may 
be arbitrary correlations between in- and out-degrees of 
the same vertex. The critical exponents, as well as the 
critical points, essentially dependent on these in-, out- 
degree correlations. 



F. Giant component in growing networks 

The intrinsic large-scale inhomogeneity of nonequilib- 
rium (e.g., growing) networks may produce a surprising 
critical phenomenon. The large-scale inhomogeneity here 
means the difference between properties of vertices ac- 
cording to their age. This difference usually makes the 
"old" part of a growing network more "dense" than the 
" young" one. 

I Callaway et al. 1 (1200 ID found an unexpected effect in 
the birth of the giant connected component already in 
a very simple model of the growing network. In their 
model, the network grows due to two parallel processes: 
(i) there is an inflow of new vertices with the unit rate, 
and, in addition, (ii) there is an inflow of edges with 
rate b, which interconnect randomly chosen vertex pairs. 
The rate b plays the role of the control parameter. As 
one could expect, the resulting degree distribution is 
very simple — exponential. The inspection of this net- 



work when it is already infinite shows that it has a giant 
connected component for b > be, where be is some critical 
value, unimportant for us. Remarkably, the birth of the 
giant connected component in this net strongly resem- 
bles the famous Berezinskii-Kosterlit z- Thouless ( BKT, 
phase transition in condensed matter ( Berezinskiil . Il97i 



i 



iKostcrlitz and Thouless, 1973). Near the critical point, 
the relative size of the giant connected component has 
the specific BKT singularity: 



S oc exp(— const /\/6 — be 



(37) 



Note that in an equilibrium network with the same de- 
gree distribution, S would be proportional to the small 
deviation b — bc- The singularity (|37p. with all derivatives 
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vanishing at the critical point, imphes an infinite order 
phase transition. 

Normally, the BKT transition occurs at the lower crit- 
ical dimension of an interacting system, where critical 
fluctuations are strong, e.g., dimension 2 for the XY 
model. Most of known models with this transition have 
a continuous symmetry of the order parameter. So that 
the discovery of the BKT singularity in infinite dimen- 
sional small worlds, that is in the mean- field regime, was 
somewhat surprising. The mean size of a finite connected 
component to which a vertex belongs in this network was 
also found to be nontraditional. This characteristic — an 
analogy of susceptibility — has a finite jump at this tran- 
sition and not a divergence generic for equilibrium net- 
w orks and disordered lattices. 

iDorogovtsev et a/] (2001b,) analytically studied a much 
wider class of growing networks with an arbitrary linear 
preferential attachment (which may be scale-free or expo- 
nential) and arrived at very similar results. In particular, 
they found that the constant and he in Eq. ([57]) depend 
on the rules of the growth. Looking for clues and parallels 
with the canonical BKT transition, they calculated the 
size distribution of connected components, Vs{s), char- 
acterizing correlations. The resulting picture looks as 
follows. 

• The distribution Vs{s) slowly (in a power-law fash- 
ion) decays in the whole phase without the giant 
connected component, and this distribution rapidly 
decreases in the phase with the giant connected 
component. 

This picture is in stark contrast to the equilibrium net- 
works, where 

• the distribution Ps{s) slowly decays only at the 
birth point of the giant connected component (if 
a network is non-scale- free, see Sec. IIII.B.Sp . 

In this respect, the observed transition in growing net- 
works strongly resembles the canonical BKT transitions, 
where the critical point separates a phase with rapidly 
decreasing correlations and "a critical phase" with corre- 
lations decaying in a power-law fashion. (Note, however 
the inverted order of the phases with a power-law decay 
and with a rapid drop in these transitions.) 

This phase transition was later observed in many 
other growing networks with exponential and scale- 
free degre e distributions ( only for some of these net - 
works, see lLan castcr (2002'), Co ulomb and Ba uer (2003"), 

mm, 



Bollobas and Riordan 



iKrapivskv and D er ri d a - .. , ^ . 

(|2005l ). and lDurretd (|20"06h '). IVIoreover, even ordinary, 
"equilibrium" bond percolation considered on special 
networks has the same critical phenomenon. For ex- 
ample, (i) grow up an infinite random recursive graph 
(at each time step, add a new vertex and attach it to 
m randomly chosen vertices of the graph), (ii) consider 
the bond percolation problem on this infinite network. 
We emphasize that the attachment must be only random 



here. It is easy to see that the resulting network may be 
equivalently prepared by using a stochastic growth pro- 
cess which just leads to the BKT-like transition. Sim- 
ilar effects were observed on the Ising and Potts mod- 
els placed on growing networks (see Sec. IVI.G.ip . A 
more realistic model of a growing protein interaction net- 
work where a giant connected component is born with 
the B KT-type singularity was described by Kim et "oZI 
(I2OO2D . 

Various percolation problems on deterministic (grow- 
ing) graphs may be solved exactly. Surprisingly, percola- 
tion properties of deterministic graphs are rather similar 
to those of their random ana logs. For detailed d i scussio n 



of these prob l ems, see, e.g. . IDorogovtsev et al. (l2002a^■ 
'Poro govtsevl ( 20031 ). and iRozenfeld and ben-AvrahamI 
(.20071) . 



G. Percolation on small-world networks 

Let us consider a small-world network based on a d- 
dimensional hypercubic lattice (N = L"*) with random 
shortcuts added with probability (f> per lattice edge. Note 
that in this network, in the infinite network limit, there 
are no finite loops including shortcuts. All finite loops 
are only of lattice edges. This fact allows one to apply 
the usua l tree ansatz to this a ctually loopy network. In 
this wav lNewman et al. 1 (I2002D obtained the statistics of 
connected components in the bond percolation problem 
for two-dimensional small- world networks. Their qualita- 
tive conclusions are also valid for bond and sit e percol a- 
tion on one-dimensional (| M oore and Newmanl [2000al lbl: 
iNewman and Wattsl . 11999 Jbl l" and arbitrary-dimensional 
small- world networks. 

In the spirit of classical random graphs, at the perco- 
lation threshold point, Pc, there must be one end of a 
retained shortcut per connected component in the lat- 
tice substrate. In more strict terms, this condition is 
2d(j)pc = l/{no){pc), i.e., the mean density of the ends of 
shortcuts on the lattice substrate must be equal to the 
mean size (no) of a connected component (on a lattice) 
to which a vertex belongs. In the standard percolation 
problem on a lattice, {no){p) (x (pco —p)~'^i where Pco 
and 7 are the percolation threshold and the " suscepti- 
bility" critical exponent in the standard percolation. So, 
the percolation threshold is displaced by 



PcO - Pc oc 



a/7 



(38) 



if (j) is small (jWarren et Ml, I2003D . For example, for 
the bond percolation on the two-dimensional small-world 
network, pcO = 1/2 and 7 = 43/18 = 2.39 . . .. The mean 
size of a connected component to which a random vertex 
belongs is also easily calculated: 



(n) = (no)/(l - 2c?(/)p(no)) cx {pc - p)' 



(39) 



So that its critical exponent equals 1, as in the classical 
random graphs. The other percolation exponents also 
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coincide with their values for classical graphs. In general, 
this claim is equally valid for other cooperative models on 
small- world networks in a close environment of a critical 
p oint. 

lOzanal (1200 ih described the entire crossover from the 
lattice regime to the small-world one and finite size ef- 
fects by using scaling functions with dimensionless com- 
binations of the three characteristic lengths: (i) L, (ii) 
the mean Euclidean distance between the neighboring 
shortcut ends, ^sw = l/(2d(/'p)^^'^, and (iii) the usual cor- 
relation length ^1 for percolation on the lattice. For an 
arbitrary physical quantity, X{L) = f{£^sw/L,S^\/L), 
where a; and /( , ) are scaling exponent and function. In 
the case of L — > cxj, this gives X — CKv^f 5(fsw/6)) where 
y, z, and g{ ) are other scaling exponents and function. 
This scaling is equally applicable to many other cooper- 
ative models on small- world networks. 



H. /c-clique percolation 

A pos sible generalization o f percolation was put for- 
ward bv lDerenvi et alj ( 20051 ). They considered percola- 
tion on the complete set of the /c-cliques of a network. 
The fc-clique is a fully connected subgraph of k vertices. 
Two /c-cliques are adjacent if they share k — 1 vertices. 
For example, the smallest non-trivial clique, the 3-clique, 
is a triangle, and so that two triangles must have a com- 
mon edge to allow the "3-perc olation" . 

In fact. lDerenvi et all ( 20051 ) described the birth of the 
giant connected component in the set of the fc-cliques of a 
classical random graph — the Gilbert model. The fc-clique 
graph has vertices — fc-cliques — and edges — connections 
between adjacent fc-cliques. The total number of fc- 
cliques approximately equals N^p'^'^^~'^'^/'^ /k\. The degree 
distribution of this graph is Poissonian, and the mean de- 
gree is {q) = Nkp^~^, which may be much less than the 
mean degree in the Gilbert model, Np. 

Since the sparse classical random graphs have few 
(fc>3)-cliques, this kind of percolation obviously implies 
the dense networks with a divergent mean degree. The 
application of the MoUoy-Reed criterion to the fc-clique 
graph gives the birth point of the fc-clique giant connected 
component 



e-core 



Pc{k)N 



k-l 



(40) 



(for more detail, see iPalla et al\ (|2007[ )'). 

The birth of the giant connected component in the fc- 
clique graph looks quite standard and so that its relative 
size is proportional to the deviation [p — Pc{k)] near the 
critical point. On the other hand, the relative size Sk 
of the (fc > 3)-clique giant connected component in the 
original graph (namely, the relative number of vertices 
in this component) evolves with p in a quite different 
manner. This component emerges abruptly, and for any 
p above the threshold Pc{k) it contains almost all vertices 
of the network: Sk{p<Pc{k)) = and Sk{p>Pc{k)) = 1. 




FIG. 14 Construction of the e-core of a given grapli. Conse- 
quently removing the leaf [23] and a new leaf [45] we obtain 
one isolated vertex and the e-core of the graph. Removing 
at first the leaf [13] and then the leaf [45] leads to the same 
e-core and the same number of isolated vertices. Compare 
with the 3-core of the same graph in Fig. [S] 



I. e-core 

Let us define a leaf as the triple: a dead end vertex, its 
sole nearest neighbor vertex, and the edge between them. 
A more traditional definition does not include the neigh- 
bor, but here for the sake of convenience we modify it. A 
number of algorithms for networks are based on succes- 
sive removal of these leaves from a graph. In particular, 
algorithms of this kind are used in the matching prob- 
lem and in minimal vertex covers. iBauer and Golinellil 
({2001a) described the final result of the recursive removal 
of all leaves from the Erdos-Renyi graph. They found 
that if the mean degree (g) > e = 2.718 . . ., the result- 
ing network contains a giant connected component — we 
call it the e-core to distinct from resembling terms. The 
e-core is explained in Fig. 1141 e-cores in other networks 
were not studied yet. 

For (g) < e, the removal procedure destroys the 
graph — only 0{N) isolated vertices and small connected 
components consisting in sum of o{N) vertices remain. 
At {q) = e, a second order phase transition of the birth 
of the e-core takes place. For (q) > e, a finite fraction Se 
of N vertices are in the e-core, a fraction / are isolated 
vertices, and negligible fraction of vertices are in finite 
components. In the critical region. 



5e-12((g)-e)/e, 



(41) 



and the mean degree {q)e of the vertices in the e-core at 
the moment of its birth is exactly 2 which corresponds 
to a tree graph. In the critical region. 



{q)e = 2 



(42) 



This singularity is in sharp contrast to the analytic be- 
havior of the mean degree of the usual giant connected 
component of this graph at the point of its birth. The 
relative number of isolated vertices has a jump only in 
the second derivative: 



3-e 



-{{q)-e) + - 
e 



3g((g)-e) 
2e 



((9> 



(43) 



where 9{x < 0) = and 9{x > 0) = 1. Interestingly, 
the leaf removal algorithm slows down as {q) approaches 
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the critical point, which is a direct analog of the well- 
known critical slowing down for usual continuous phase 
transitions. 

The same threshold (q) = e is present in several combi- 
natorial optimization problems on the classical random 
graphs. In simple terms, in each of these problems, a 
solution may be found "rapidly" only if (q) < e. Above 
e, any algorithm applied needs a very long time. Note 
that this statement is valid both for the efficiently solv- 
able in polynomial time, P (deterministic polynomial- 
time) problems and for the NP (non-deterministic poly- 
nomial time) problems. In particular, the e thresh- 
old takes place in the matching (P) problem — find in a 
grap h the maximum set of e dges without common ver- 
tices ( Karp and SiDseil . ll98ll ). and, also, in the minimum 
vertex cover (NP) problem — if a guard sitting at a ver- 
tex controls the incident edges, find the minimum set 
of guards needed to w a tch ov er all the edges of a graph 
fWeig t and Hartmannl . 120001). The matching p roblem, 
belonging to the P class ( Aronson et all Il998f l. is ac- 



multiple connections, loops of length one, and other 
arbitrary configurations are allowed. There exist a 
number of more or less equ i valent models of these 



tually equivalent to the model of dimers with repulsion. 
We will discuss the minimum vertex cover in Sec. lVI.E.3l 
Here we only mention that in the combinatorial optimiza- 
tion problems, the e threshold separates the phase (q) < e 
with a "simple" structure of the "ground state" , where 
the replica symmetry solution is stable from the phase 
with huge degeneracy of the "ground state" , where the 
replica symmetry breaks. In particular, this degeneracy 
implies a huge number of minimum covers. 

Note another class of problems, where leaf removal is 
essential. The adjacency matrix spectrum is relevant to 
the localization/delocalization of a quantum particle on 
a graph, see Sec. IXII.EI It turns out that that leaf re- 
moval does not change the degeneracy of the zero eigen- 
value of the adjacency matrix, and so the e-core notion 
is closely related to the str ucture of this spectrum and 
to localization phenomena. I Bauer and Golinellil (|2001aD 
showed that the number of eigenvectors with zero eigen- 
value equals the product IN, see Eq. (|43| . and thus has a 
jump in the second derivative at (g) ~ e. See Sec. IXII.EI 
for more detail. 



IV. CONDENSATION TRANSITION 

Numerous models of complex networks show the fol- 
lowing phenomenon. A finite fraction of typical struc- 
tural elements in a network (motifs) — edges, triangles, 
etc. — turn out to be aggregated into an ultra-compact 
subgraph with diameters much smaller than the diam- 
eter of this network. In this section we discuss various 
types of this condensation. 



A. Condensation of edges in equilibrium networks 

Networks with multiple connections. We start with 
rather simple equilibrium uncorrelated networks, where 



netw or ks (iBauer and Berna rd. '20021; iBerg arid Lassid . 



2002t iBurda aLl. l200lt iDorogovtsev aLl. l2003t: 



Farkas et all 120041 ). In many respects, these networks 



are equivalent to an equilibrium non-network system — 
balls statistically distributed among boxes — and so that 
they can be easily treated. On the other hand, the 
balls- in-boxes model has a condensatio n phase transition 
( Bialas et [1993 lurda et al. 1. 120021) . 

We can arrive at uncorrelated networks with complex 
degree distribution in various ways. Here we mention two 
equivalent approaches to networks with a fixed number 
N of vertices. 

(i) Similarly to the balls-in-boxes model , one can de- 
fine the statistical weights of the random ensemble mem- 
bers in the factorized form: YiiLiPili) (|Burda et all 
120011) . where the "one-vertex" probability p{q) is the 
same for all vertices (or boxes) and depends on the de- 
gree of a vertex. If the number of edges L is fixed, these 
weights additionally take into account the following con- 
straint ^ • qi = 2L. With various p{q) (and the mean 
degree (q) = 2L/N) we can obtain various complex de- 
gree distributions. 

(ii) A more "physical", equivalent approach is as fol- 
lows. A network is treated as an evolving statistical en- 
semble, where ed ges permanently change the ir positions 
between vertices ( Dorogovtsev et all . l2003bl ). After re- 
laxation, this ensemble approaches a final state — an equi- 
librium random network. If the rate of relinking factors 
into the product of simple, one-vertex-degree preference 
functions /(g), the resulting network is uncorrelated. For 
example, one may choose a random edge and move it to 
vertices i and j selected with probability proportional to 
the product fiqi)fiqj)- The form of the preference func- 
tion and (q) determines the distribution of connections 
in this network. 

It turns out that in these equilibrium networks, scale- 
free degree distributions can be obtained only if f(q) is 
a linear function. Furthermore, the value of the mean 
degree plays a crucial role. If, say, f{q) = q + 1 — j 
as g ^ 00, then three distinct regimes are possible, (i) 
When the mean degree is lower than some critical value 
qc (which is determined by the form of f{q)), the degree 
distribution P{q) is an exponentially decreasing function, 
(ii) If (q) = qc, then P{q) ~ q~'^ is scale- free, (iii) If 
(q) > qc, then one vertex attracts a finite fraction of all 
connections, in sum. Lex = N{{q) — qc)/^ edges, but the 
other vertices are described by the same degree distribu- 
tion as at the critical point. In other words, at (q) > qc, 
a finite fraction of edges are condensed on a single ver- 
tex, see Fig. ITST a). One can show that it is exactly one 
vertex that attracts these edges and not two or three or 
several. Notice a huge number of one-loops and multiple 
connections attached to this vertex. We emphasize that 
a scale-free degree distribution without condensation oc- 
curs only at one point — at the critical mean degree. This 
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FIG. 16 The structure of a network without multiple con- 
nections when its vertex mean degree exceeds a critical value. 
The size Nh{N) of the highly interconnected core varies in 
the range of ~ N^^^ and ~ A''^''^ vertic es. These vertices 
are in terconnected by ~ A'' edges. From iDorogovtsev et "all 
(|2005l ). 



FIG. 15 Schematic plots of the degree distributions of the 
equilibrium networks with (a) and without (b) multiple con- 
nections in the condensation phase w here the mean degree 
exceeds the critical value (Dorogovt sev et~al\ . 2005). The 
peaks are due to a single vertex attracting Lex = N{{q)—qc)/2 
edges (a) or due to the highly interconnected core vertices of 
typical degree Q ~ N/Nh{N) (b). Note the difference from 
the rich club phenomenon, where there are no such peaks in 
degree distributions. From IPoroeovtsev et al\ l|2005l ). 



is in contrast to networks growing under the mechanism 
of the preferential attachment, where Unear preference 
functions generate scale-free architectures for wide range 
of mean degrees. 

One can arrive at the condensation of edges in a 
quite different way. In th e spirit of the work of 
iBianconi and Barabasil ( 200lh . who apphed this idea to 
growing networks, let few vertices, or even a single ver- 
tex, be more attractive than others. Let, for example, the 
preference function for this vertex be gf{q), where f{q) is 
the preference function for the other vertices, and g > 1 
is a constant characterising a relative "strength" or "fit- 
ness" of this vertex. It turned out that as g exceeds some 
critical value gci a- condensation of edges on th is "strong" 
vertex occurs ( Dorogovtsev and Mendesl . l2003l ). Interest- 
ingly, in general, this condensation is not accompanied by 
scale-free organization of the rest network. 



Networks without multiple connections. If multiple 
connections and one-loops are forbidden, the structure 
of the condensate changes cr ucially. This difficult prob - 
lem was analytically solved in IDorogovtsev et al\ ( 2005t ). 
The essential difference from the previous case is only in 
the structure of the condensate. It turns out that in these 
networks, at {q) > q^, a finite fraction of edges, involved 
in the condensation, link together a relatively small, 
highly interconnected core of Nh vertices, Nh{N) <^ N, 
Fig. [ini This core, however, is not fully interconnected, 
i.e., it is not a cHque. (i) If the degree distribution P{q) 
of this network decreases slower than any stretched expo- 
nential dependence, e.g., the network is scale- free, then 
Nh - (ii) In the case of a stretched exponential 



P{q) ^ exp(— const q"), < a < 1, the core consists of 
Nh - Ar(2-")/(3-a) (44) 

vertices, that is the exponent of Nh{N) is in the range 
(1/2,2/3). The connections inside the core are dis- 
tributed according to the Poisson law, and the mean de- 
gree ~ N/Nh varies in the range from ~ N/N^/'^ ~ iV-^/^ 
to - N/N"^/^ ~ 

In the framework of traditional statistical mechan- 
ics, one can also construct networks with various cor- 
relations (Berg and Lassig, 2002,), directed networks 



( Angel et all 120061 ) and man y others. iDerenvi etcdX 
2004l ). |Palla et al\ (|2004l ) , and lFarkas et al\ (|2004l ) con^ 



structed a variety of network ensembles, with statisti- 
cal weights of members (x Hi S'^pI"^!*)]; where E[q) 
is a given one- vertex degree function — "energy", as they 
called it. In particular, in the case E{q) = —const gin 
these authors numerically found an additional, first-order 
phase transition. They studied a variation of the max- 
imum vertex degree (?max in a network. As, say, {q) 
reaches qc^ a condensation transition takes place, and 
^max approaches the value ^ N{q), i.e., a finite frac- 
tion of all edges. Remarkably, at some essentially higher 
mean degree, qc2, ^max sharply, with hysteresis, drops to 
~ N^^^. That is, the network demonstrates a first order 
phase transition from the condensation ( "star" ) phase to 
the "fully connected graph" regime. 



B. Condensation of triangles in equilibrium nets 

The condensation of triangles in network mo dels was 
alread y observed in the pioneering work of IStraussI 
(jl986^. Strauss proposed the exponential model, where 
statistical weights of graphs are 



W{g)=c^p[-J2PnEnig) 



(45) 



Here En{g) is a set of some quantities of a graph g — a 
member of this statistical ensemble, and /?„ is a set of 
some positive constants. The reader may see that many 
modern studies of equilibrium networks are essentially 
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based on the exponential model. Strauss included the 
quantity E^{g), that is the number of triangles in the 
graph g taken with the minus sign, in the exponential. 
This term leads to the presence of a large number of tri- 
angles in the network. On the other, hand, they turn 
out to be very inhomogeneously distributed over the net- 
work. By simulating this (in his case, very small) network 
Strauss discovered that all triangles merge together form- 
ing a clique (fully connected subgraph) in the network — 
t he condensati o n of tr iangles . 

iBurda et al\ (|2004al |bl) analytically described and ex- 
plained this non-trivial phenomenon. Let us discuss 
the idea and results of their theory. The number of 
edges, L, and the number of triangles, T, in a net- 
work are expressed in terms of its adjacency matrix, 
A. Namely, L = Tr{A'^)/2\ and T = Tr{A^)/3\. The 
partition function of the Erdos-Renyi graph is simply 
= J2a S{Tr{A^) — 2L), where sum is over all possible 
adjacency matrices. In the spirit of Strauss, the simplest 
generalization of the Erdos-Renyi ensemble, favoring tri- 
angles, has the following partition function 



Z 



A 



S{Tr{A^) - 2L)e 



GTr(A^)/3! 



Zo{e 



GTr{A^)/3\\ 



(46) 

where the constant G quantifies the tendency to have 
many triangles, and (. . .)o denotes the averaging over 
the Erdos-Renyi ensemble. Equation shows the 

form of the partition function for the canonical en- 
semble, i.e., with fixed L. In the grand canon- 
ical formulation, it looks more invariant: Zgc ~ 
X;iexp[-Crr(i2)/2! + GTr(i3)/3!] (we here do not 
discuss t he co nstant C). In fact, based on this form, 
IStraussI ( 19861 ) argued that with L/N finite and fixed, 
there exists a configuration, where all edges belong to a 
fully connected subgraph and so Tr{A'^) ^ A^3/2 
Therefore, as ^ cxd, for any positive "interaction con- 
stant" G, the probability of realization of such a config- 
uration should go to 1, which is the stable state of this 
theory. 

The situation, however, is more delicate. Burda et 
al. showed that apart from this stable condensation 
state, the network has a metastable, homogeneous one. 
These states are separated by a barrier, whose height 
approaches infinity as iV — > oo. So, in large networks 
(with sufficiently small G) , it is practically impossible to 
approach the condensation state if we start evolution — 
relaxation — from a homogeneous configuration. (Recall 
that Strauss numerically studied very small networks.) 

Assuming small G, Burda et al. used the second equal- 
ity in Eq. (|46p to make a perturbative analysis of the 
problem. They showed that in the "perturbative phase" , 
the mean number of triangles (T) = ((g)^/6) exp(G), 
where (q) is the mean degree of the network, see Fig. [T71 
In this regime, the number of triangles may be large, 
(T) < N. Above the threshold Gt{{q),N) « alniV + b, 
where the coefficients a and b depend only on (q) , the sys- 
tem easily jumps over the barrier and quickly approaches 




FIG. 17 The mean number of triangles (T) as a function of 
the parameter G in the metastable state of the network of 
TV — 2^"^ vertices for three values of the mean degree (g) — 
2, 4, 8. The dots are results of a simulation, and the lines are 
theoretical curves (T) = {{q)^/6) exp(G) < N. The very right 
dot in each set corresponds to the threshold value Gt{{q)) 
above which the network quic kly approaches the co ndensation 
state with (T) ~ iV^/^. From lBurda et al\ (|2004al '). 



t he condensati o n state . 

iBurda et al\ ( 2004b[ ) generalized this theory to net- 
works with complex degree distributions using the parti- 
tion function Z = J2a S{Tr{A^) -2L)e^^'-^^'^ Jjf p{q,), 
where qi is the degree of vertex i, and the weight p{q) 
is given. In an even more general approach, Tr{A^) 
in the exponential should be replaced by a more gen- 
eral perturbation S{A). Note that a different perturba- 
tion theory for the expone ntial model was developed by 
iPark and NewmanI (|2004allbl ) . 



C. Condensation of edges in growing networks 



iBianconi and Barabasil (|200lh discovered the conden- 
sation phase transition in networks, growing under the 
mechanism of preferential attachment. In their inhomo- 
geneous network, preference function of vertices had a 
random factor ("fitness"): gif{qi) distributed according 
to a given function p{g). Bianconi and Barabasi indi- 
cated a class of sufficiently long-tailed distributions p{g), 
for which an infinitely small fraction of vertices (maxi- 
mally fitted ones) attract a finite fraction of edges. In 
fact, this condensation may be obtained even with a 
single more fitted vertex ( 7): q j^^ = 1, gj — g > 1 
( Dorogovtsev. and Mende"^ . l200lh . In this case, the con- 
densation on this vertex occurs in large networks of size 
t 3> J, if 5 exceeds some critical value gc- 

Suppose that the network is a recursive graph, and the 
preference function f{q) is linear. Then gc — 70 — 1, 
where 70 is the exponent of the degree distribution of 
this network with all equal vertices {g = 1). Note that if 
the degree distribution is exponential (70 00), gc 
00, and the condensation is impossible. If 5 < g^, the 
degree distribution of the network is the same as in the 
"pure" network. On the other hand, the phase with the 
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condensate, g > Oc has the following characteristics, (i) 
A finite fraction of edges d (x {g — gc) is attached to the 
"fittest" vertex, (ii) The degree distribution exponent 
increases: 7 = 1+g > 70- (hi) In the entire condensation 
phase, relaxation to the final state (with the fraction d 
of edges in the condensate) is very slow, of a power-law 



a more strict approach see, e.g., iNewma i (l2002aD . 
iKenah and Robina ( 20061 ). and references therein. 

Let a network have only degree-degree correlations, 
and so it is defined by the conditional probability P{q'\q), 
see Sec. IIILCI Consider the evolution of the probabili- 
ties iq(t), Sq{t), and rq{t) that a vertex of degree q is in 



kind: dj{t) — d ^ t 9c)/ g ^ Here dj{t) is a condensed the I, S, and R states, respectively. For example, iq{t) — 



fraction of edges at time t. 

Bianconi and Barabasi called this phenomenon the 
Bose-Einstein condensation based on evident parallels (in 
fact, this term was also applied sometimes to condensa- 
tion in equilibrium networks, in the balls- in-boxes model, 
and in zero-range processes). We emphasize the com- 
pl etely classi c al nat ure o f this condensation . 

iKim et al\ (|2005l ) and Minn hagen et al\ (|2004l ) intro- 
duced a wide class of equilibrium and growing networks, 
where complex architectures are results of the process of 
merging and splitting of vertices. In many of these net- 
works (where vertices differ from each other only by their 
degrees) the condensation of edges takes place. This phe- 
no menon in the networks with aggregation was studied 
ava and DorogovtsevI (|200a) . 



V. CRITICAL EFFECTS IN THE DISEASE SPREADING 

The epidemic spreading in various complex networks 
was quite extensively studied in recent years, and it is 
impossible here to review in detail and even cite numer- 
ous works on this issue. In this section we only explain 
basic facts on the spread of diseases in networks, discuss 
relations to other phenomena in complex networks, and 
describe several recent results. The reader m ay refer to 
iPastor-Satorras and Vespignanil ( 20031 12004| ) for a com- 
prehensive introduction to this topic. 



A. The SIS, SIR, SI, and SIRS models 

Four basic models of epidemics are wi dely us e d: th e 
SIS, SIR, SI, and SIRS models, see, e.g., [Miiil dlool). 
S is for susceptible, I is for infective, and R is for recov- 
ered (or removed). In the network context, vertices are 
individuals, which are in one of these three (S,I,R) or two 
(S,I) states, and infections spread from vertex to vertex 
through edges. Note that an ill vertex can infect only its 
nearest neighbors: S^I. 

The SIS model describes infections without immunity, 
where recovered individuals are susceptible. In the SIR 
model, recovered individuals are immune forever, and do 
not infect. In the SI model, recovery is absent. In the 
SIRS model, the immunity is temporary. The SIS, SIR, 
and SI models are particular cases of the more general 
SIRS model. We will touch upon only first three models. 

Here we consider a h e uristic appr oach of 
iPastor-Satorras and Vespignanil (j200lL l2003l ). This 
(a kind of mean-field) theory fairly well describes 
the epidemic spreading in complex networks. For 



(number of infected vertices of degree q) /[N P{q)\. As is 
natural, iq{t) + Sq{t) + rq{t) — 1. Let A be the infection 
rate. In other words, a susceptible vertex becomes in- 
fected with the probability A (per unit time) if at least 
one of the nearest neighbors is infected. Remarkably, A is 
actually the sole parameter in the SIS and SIR models — 
other parameters can be easily set to 1 by rescaling. Here 
we list evolution equati ons for the SIS , SIR, and SI mod- 
els. For derivations, see lBogufia et aZ.l (,2003bl. However, 
the structure of these equations is so clear that the reader 
can easily explain them himself or herself, exploiting ob- 
vious similarities with percolation. 

The SIS model. In this model, infected vertices become 
susceptible with unit rate, rq{t) — 0, Sq{t) — I ~ iq{t). 
The equation is 



digit) 
dt 



= -iq{t) + \q[i - iq{t)] P{q'\q) wit)- (47) 



The SIR model. In this model, infected vertices be- 
come recovered with unit rate. Two equations describe 
this system: 



drqit) 
dt 



hit), 



^ = -^qit) + \q[^-^qit)]J2^Pi<l'\<l)h'it)■i'^&) 



q' 



q 



Note the factor (g' — l)/q' in the sum. This ratio is due 
to the fact that an infected vertex in this model cannot 
infect back its infector, and so one of the q' edges is ef- 
fectively blocked. 

The SI model. Here infected vertices are infected for- 
ever, Sqit) = 1 ~ iqit), and the dynamics is described by 
the following equation: 



diqit) 
dt 



\q[l 



9' 



q' 



(49) 



(compare with Eq. ([48|)). This simplest model has no 
epidemic threshold. Moreover, in this model, A may be 
set to 1 without loss of generality. 

If a network is uncorrelated, simply substitute 
Piq'\q) = q'Piq')/{q) into these equations. It is conve- 
nient to introduce 9 = Ylq'iq' ~^)Piq')H' iq) (fo^' the SIR 
model) or 6 = Y.q' q'Piq')h'{q) (for the SIS model) and 
then solve a simple equation for this degree-independent 
quantity. We stress that the majority of results on epi- 
demics in complex networks were obtained by using only 
Eqs. (137|), (05]), and (gHl)- Note that one can also analyse 
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th ese models assuming; a degree-dependent infection rate 
A (jGiuraniuc et am2006D . 



B. Epidemic thresholds and prevalence 

The epidemic threshold Ac is a basic notion in epidemi- 
ology. Let us define the fractions of infected and recov- 
ered (or removed) vertices in the final state as i(oo) — 
andr(cx)) = -P('?)^g(<^oo), respec- 
tively. Below the epidemic threshold, 1(00) = r(oo) = 0. 
In epidemiology the fraction i{t) of infected vertices in 
a network is called the prevalence. The On the other 
hand, above the epidemic thresholds, (i) in the SIS 
model, 1(00, X>X^^^) is finite, and (ii) in the SIR model, 
i{oo, A>Af = and r(oo, A>Af^^) is finite. 

The hnearization of Eqs. (gT]), (gS]), and (gHl) read- 
ily provide the epidemic thresholds. The simplest SI 
model on any network has no epidemic threshold — all 
vertices are infected in the final state, iq{t—^oo) = 1. 
Here we only discuss results for uncorrelated networks 
( Pastor-Satorras and Vespignani . [200ll gOOSih . for corre- 
lated networks, see iBoguna et aLl ~ 2003bl ). The reader 
can easily check that the SIS and SIR models have the 
following epidemic thresholds: 



> S/5 



kSIR 



(50) 



Notice the coincidence of Af^^ with the percolation 
threshold Pc in these networks, Eq. (fT7|) . (Recall that for 
bond and site percolation problems, Pc is the same.) This 
coincidence is not occasional — strictly spea king, the SIR 
model is equivalent to dynamic percolation ( Grassbergeil 
11983). In more simple terms, the SIR model, in the 
respect of its final state, is pract ically equivalen t to 
the bond percolation problem [see iHastingd ( 2006[ ) for 
discussion of some difference, see al s o disc ussions in 
iKenah and Rob ins (2006 ) and iMilleil (|2007l )]. Equa- 
tion ([SU)) shows that general conclusions for percolation 
on complex networks are also valid for the SIS and SIR 
models. In particular, (i) the estimates and conclusions 
for Pc from Sees. IIII.B.21 IIII.B.31 and IIII.B.4I are valid 
for the SIS and SIR models (simply replace Pc by Af ■^'^ 
or Af^^), the finite size relations also work; and (ii) the 
estimates and conclusions for the size S of the giant con- 
nected component from these sections are also valid for 
i{oo) in the SIS model and for r{oo) in the SIR model, 
i.e., for prevalence. 

In particular, iPastor-Satorras and Vespignanil ( 200X1 ) 
discovered that in uncorrelated networks with diverg- 
ing (g^), the epidemic thresholds approach zero value, 
but a finite epidemic threshold is restored if a, net- 
work is finite (iBoguna et aLl, 120041: iMav and Llovdl . l200ll: 



iPastor-Satorras and Vespignanil . 2002a ). Similarly to 
percolation, the same condition is valid for networks 
with degree-degree correla tions ( Boguna et all l2003al : 
iMoreno and Vazauej . l2003[) . 



The statistics of outbreaks near an epidemic threshold 
in the SIR model is similar to that for finite connected 
components near the birth point of a giant component. 
In particular, at a (SIR) epidemic threshold in a net- 
work with a rapidly decreasing degree distribution, the 
maximum outbreak s cales as N^/^ and the mean out - 
break scales as N^^^ i Ben-Nairn and Krapivskvl . |2004J ). 
(In the SIS model, the corresponding quantities behave 
as N and N^^^.) These authors also estimated duration 
of epidemic outbreaks. At a SIR epidemic threshold in 
these networks, the maximum duration of an outbreak 
scales as A^^/^, the average duration scales as InA^, and 
the typical duration is of the order of one. 

Interestingly, some of results on the disease spreading 
on complex networks we re obtained before those for per- 
colatio n, see the work of lPastor-Satorras and Vespignanil 
(120011) . I'^or example, they found that in the SIS and 
SIR model on the uncorrelated scale-free network with 
degree distribution exponent 7 = 3, the final preva- 
lence is proportional to exp[— g((q))/A)]. Here g{{q)) 
depends only on the mean degree. That is, all deriva- 
tives of the prevalence over A equal zero at this spe- 
cific point (recall t he corresponding result for percola - 
tion). Furthermore. IBoguna and Pastor-Satorrad ( 2002! ) 
fulfilled numerical simulations of t h e SIS model on the 
growing network of ICallawav et all ()200ll ) and observed 
prevalence proportional to exp[— const/ VA — Ac] , i.e., the 
Berezinskii-Kosterlitz-Thouless singularity. 

Disease spreading was also studied in many other 
net works. For exampl e, for small-world networks, 
see 



Moore and Newinal] (|2000al) : iNewmanI (|2002al) : 
iNewman et al\ ( 20021 ) and references therein. For 
epidemic s in n et works with high clusterin g, 



NewmanI f2003bl): iPetermann and De Los Riod (|2004l ): 
Serrano and Bogufial ( 2006al ). A very p opular topic 



see 



vari ous immunization stra teg ies, s ee Cohen et al. 



Dezso and Barabasil (l2002^: iGallos et al. 
2007al ): iPastor-Satorras and Vespignanil (|2002bL l200: ~ 



and many other works. 

Note that the excitation of a system of coupled neu- 
rons in response to external stimulus, in principle, may 
be considered similarly to the disease spreading. Ex- 
citable networ ks with comp l ex ar c hitectures were stud- 
i ed iniKinouchi and CopeUi ( 20061 ). ICopelli and Campod 
(|2007D . and lWu et al\ (|200m 



C. Evolution of epidemics 



Equations (gZl), (gS]), and dH]) describe the dynam- 
ics of epidemics. Let us discuss this dynamics above 
an epidemic threshold, where epidemic outbreaks are gi- 
ant, t hat is involve a finite fraction of vertices in a net- 
work (iBarthelemv et aLl . l2004 120051: iMoreno et aLl . 120021: 
IVazauej . l2006al) . The demonstrative SI model is espe- 
cially easy to analyse. A characteristic time scale of the 
epidemic outbreak can be tr i vially obtai ned in the follow- 
ing way (jBarthelemv et all . |2004 l2005l ). Let the initial 
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Actually he studied a variation of the SI model, with an 
"average generation time" Tq ^ 1/A. In this model he 
analytically found 

di{t)/dt(xt'^'^-''-^e^*/^'^, (53) 

where ^max(-^) is the diameter of the network (the max- 
imum intervertex distance). Vazquez compared this de- 
pendence with his numerical simulations of the SI model 
on a generated network and a real-world one (the Inter- 
net at the Autonomous System level). He concluded that 
Eq. ([55]) provides a reasonable fitting to these results even 
in rather small networks. 

VI. THE ISING MODEL ON NETWORKS 



FIG. 18 The evolution of the average fraction of infected 
vertices in the SIR model on the Barabasi-Albert network of 
10*' vertices for various initial conditions. At t = 0, randomly 
chosen vertices of a given degree q are infected. The spreading 
rate is A = 0.09 whic h is above the e pidem ic threshold of this 
finite network. From lMoreno et al\ (|2002l ). 



condition be uniform, iq{t = 0) = iq. Then in the range 
of short times the prevalence i{t) = J2q Pil)'^q{t) rises 
according to the law: 



{q') - (q) 



t/T 



1) 



with the time scale 



{q) 



w)-{q)y 



(51) 



(52) 



Thus T decreases with increasing (q^). As is natural, the 
law (|5ip is violated at long times, when i{t) ~ 1. Expres- 
sions for r in the SIS and SIR models are qualitatively 
similar to Eq. (|52p . 

Notice some difference between the SIR and SIS (or 
SI) models. In the SIS and SI models, the fraction of 
infected vertices i{t) monotonously grows with time un- 
til it approaches the final stationary state. Adversely, in 
the SIR model, i{t) shows a peak — outbreak — at t ^ t 
and approaches zero value as i — > cx). As a result of 
heterogeneity of a complex network, the epidemic out- 
breaks strongly depend on initial conditions, actually on 
a first infected individual. Figure [18] shows how the aver- 
age fraction of infected vertices evolves in the SIR model 
placed on the Barabasi-Albert netw ork if the first infecte d 
individual has exactly q neig hbors (jMoreno et all 12002^ . 
The spreading rate is supposed to be above the epidemic 
threshold. If this q is large, then the outbreak is giant 
with high probability. On the other hand, if q is small, 
then, as a rule, the infection disappears after a small out- 
break, and the probability of a giant outbreak is low. 

When ((7 ^) diverges (7 < 3), Eqs. (HID and ^ are not 
applicable. IVazqued ( 2006al ) considered disease spreading 
in this situation on a scale-free growing (or causal) tree. 



The Ising model, named after the physicist Ernst Ising, 
is an extremely simplified mathematical model describing 
the spontaneous emergence of order. Despite its simplic- 
ity, this model is valuable for verification of general the- 
ories and assumptions, such as scaling and universality 
hypotheses in the theory of critical phenomena. What 
is important is that many real systems can be approxi- 
mated by the Ising model. The Hamiltonian of the model 
is 



(54) 



where the indices i and j numerate vertices on a net- 
work, i,j ~ l,2...iV. aij is an element of the adjacency 
matrix: = 1 or if vertices i and j are connected or 
disconnected, respectively. Network topology is encoded 
in the adjacency matrix. In general, couplings Jy and 
local fields Hi can be random parameters. 

What kind of a critical behavior one might expect if we 
put the Ising model on the top of a complex network? Is 
it the standard mean-field like behavior? A naive an- 
swer is yes because a complex network is an infinite- 
dimensional system. Indeed, it is generally accepted that 
the critical behavior of the ferromagnetic Ising model on 
a c?-dimensional lattice at d > 4 is described by the simple 
mean-field theory which assumes that an average effec- 
tive magnetic field H + JziM acts on spins, where M is 
an average magnetic moment and zi — (q) is the mean 
number of the nearest neighbors. An equation 



M = taTih[(3 H + 13 JziM] 



(55) 



determines M. This theory predicts a second order 
ferromagnetic phase transition at the critical tempera- 
ture Tmf = Jzi in zero field with the standard criti- 
cal behavior: M ^ , x = dM/dH ~ |''"| where 
T = Tmf - T, ^ = 1/2, and 7=1. First investi- 
gations of the ferromagnetic Ising model on the Watts- 
Strogatz netwo rks revea led the se cond ord er phase t ransi- 
tion i Barrat and Weigtl.i2 000; Gi ttermanl . 2000; He rrerol 



l2002l : nHong et all l2002blV This result qualitatively 



agreed with the simple mean-field theory. 
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Numerical simulations of the ferromagnetic Ising 
model on a grow i ng Ba rabasi-Albert scale-free network 
( Aleksieiuk et al\ . l2002f ) demonstrated that the critical 
temperature Tc increases logarithmically with increas- 
ing N: Tc{N) ~ InA^. Therefore, in the thermody- 
namic limit, the system is ordered at any finite T. The 
simple mean-field theory fai ls to explain this behav- 
ior. Analyti c al inve stigations ( Dorogovtsev et a]] . l2002bt 
iLeone et M l2002^ based on a microscopic theory re- 
vealed that the critical behavior of the ferromagnetic 
Ising model on complex networks is richer and extremely 
far from that expected from the standard mean-field the- 
ory. They showed that the simple mean-field theory does 
not take into account the strong heterogeneity of net- 
works. 

In the present section, we look first at exact and ap- 
proximate analytical methods (see also Appendices \X[ iBl 
[C|) and then consider critical properties of ferro- and an- 
tiferromagnetic, spin-glass and random-field Ising models 
on complex networks. 




FIG. 19 A cluster on a graph. Within the Bethe-Peierls ap- 
proach we choose a cluster consisting of spin i and its nearest 
neighbors (closed circles). Cavity fields ipj\i (vertical arrows) 
take into account interactions with remaining spins (dotted 
lines and open circles). Hi is a local field. Arrows along 
edges show fields created by neighboring spins at vertex i. 



Consider a cluster consisting of a central spin Si and 
its nearest neighbors Sj , see Fig. [121 The energy of the 
cluster is 



Hci — ^ ^ JijSiSj HiSi 



(56) 



A. Main methods for tree-like networks 



1. Bethe approach 



The Bethe-Peierls approximation is one of the most 
powerful met hods for studying coop erative pheno mena 



(jPombl . Il960f ). It was propo sed by iBethd (|l935f) and 
then applied by iPeierld (|l936l ) to the Ising model. This 
approximation gives a basis for developing a remarkably 
accurate mean- field theory. What is important, it can be 
successfully used to study a finite system with a given 
quenched disorder. 

The list of modern applications of the Bethe-Peierls 
approximation ranges from sol id state phy sics, infor- 
mation and computer sciences (Pearl', '1988^ for exam- 
ple, image restoratio n (Tanaka, 2002). artificial vision 



( Freeman et aLU2000l) . decoding of error-correcting codes 
( McE liece et aLVl998V combinatorial optimization prob- 
lems CMc zard and R. Zccchina, 2002), medical diagnosis 
( Kappenl . |200^ to social models. 

Let us consider the Ising model Eq. (|54p on an ar- 
bitrary complex network. In order to calculate mag- 
netic moment of a spin Si, we must know the total 
magnetic field which acts on this spin. This gives 



M, = (S^) = tanh[/3ijf ^], where /3 = 1/T. Hi"-' includes 
both a local field Hi and fields created by nearest neigh- 
boring spins. The spins interact with their neighbors who 
in turn interact with their neighbors, and so on. As a re- 
sult, in order to calculate we have to account for all 
spins in the system. It is a hard work. 

Bethe and Peierls proposed to take into account only 
interactions of a spin with its nearest neighbors. Interac- 
tions of these neighbors with remaining spins on a net- 
work were included in "mean fields" . This simple idea 
reduces the problem of iV interacting spins to a problem 
of a finite cluster. 



where N{i) means all vertices neighboring vertex i. Inter- 
actions between the spins j G N{i) are neglected. They 
will be approximately taken into account by the fields 
(y5j\i. These fields are called cavity fie lds within the cav- 
ity method ( Mezard and ParisH l200ll ). The cavity fields 
must be found in a self-consistent way. 

It is easy to calculate the magnetic moments of spins 
in the cluster. The magnetic field H^*'' acting on i is 



jeNii 



hji, 



(57) 



where hji is an additional field created by a spin Sj at 
vertex i (see Fig. [TOl): 

tanhf3hji = tanhpjij tanh (3ipj\i. (58) 
In turn the field iJ acting on spin j is 



H^^ = iPj\t + hij, 



(59) 



where the additional field hij is created by the central 
spin i at vertex j. This field is related to the additional 
fields in Eq. ((58)) as follows: 



tanh phij — tanh pjij tanh[/3(iJi 



- E 

m£N{i)\j 



hrm)l (60) 



where N{i)\j means all vertices neighboring vertex i, 
except j. In the framework of the belief-propagation 
algorithm (Sec. IVI.A.2P the additional fields hji are 
called messages. Using this vivid term, we can interpret 
Eq. ([60]) as follows (see Fig. [20]). An outgoing message 
sent by spin i to neighbor j is determined by incom- 
ing messages which spin i receives from other neighbors 
m g N{i), except j. Note that if vertex i is a dead end. 
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The parameter B = q — 1 on the right-hand side is the 
branching parameter. 

At H = 0, the model undergoes the standard sec- 
ond order phase transition at a critical point in which 
Btanhpj = 1. It gives the critical temperature 



FIG. 20 Diagram representation of Eq. (|6Up . An outgoing 
message hij from vertex i to vertex j is determined by the lo- 
cal field Hi and incoming messages to i excluding the message 
from j. 



then from Eq. ([50)1 we obtain that the message hij from 
i to the only neighbor j is determined by a local field Hi: 



Tbp = 2J/ln[(B + l)/(S-l) 



(65) 



tanh/3ft,ij ~ tanhf3Jij tanh(/3_ffi). 



(61) 



In the limit q ^ 1 the critical temperature Tmf tends 
to Tbp, i.e., the simple mean-field approach Eq. ([55)1 be- 
comes exact in this limit. At the critical temperature 
T = Tbp , the magnetic moment M is a nonanalytic func- 
tion of iJ: M{H) - 

b. Fully connected graph. The Bethe-Peierls approxima- 
tion is exact for the fully connected graph. For example, 
consider the spin-glass Ising model with random inter- 



We can choose a cluster in which Sj is the central spin. actions | Jy | oc A^"^/^ on the graph (the Sherrington- 

Kirkpatrick model). The factor N^^^"^ gives a finite crit- 
ical temperature. In the leading order in A^, Eqs. (j57[) 
and ([50]) lead to a set of equations for magnetic moments 



The field ijj*"* is given by the same Eq. ([57)1 . Comparing 
Eq. ([57|). where j replaces i, with Eq. ([55)) . we obtain 



E 



(62) 



meAr('i)\j 



Mi = tanh 



Equations ([57|1 -([62 |) establish relations between the fields 
{hij\ and AH we need is to solve Eq. ([50)1 and 

find messages {/lij } in a graph. Apart of the local mag- 
netic moments, the Bethe-Peierls approximation allows 
one to find a spin correlation function and the free-energy. 
These formulas are given in Appendix 1X1 

The Bethe-Peierls approach is exact for a treelike graph 
and the fully connected graph. It leads to the same 
equations as the cavity method and the exact recursion 
method (see Sec. IVI.BI) . The Bethe-Peierls approach is 
approximate for graphs with loops due to spin correla- 
tions induced by loops. However, even in this case, it usu- 
ally leads to remarkably accurate results. The approach 
can be impro ved by using the Kikuchi "cluster varia- 
tion method" (|Dombl . 119601 : iKikuchil . Il95ll : lYedidia tt all . 
I2001D . 

How large are loop corrections to the Bethe-Peierls ap- 
proximation? There is no clear answer on this important 
question. Several methods have recentl y been proposed 



These are the TAP equations (jThouless et all Il977l ) 
which are exact in the thermodynamic limit. 



2. Belief-propagation algorithm 

The belief-propagation algorithm is an effective nu- 
merical method for solving inference probl ems on sparse 
graphs. It was originally proposed by iPearll ( 1988| ) 
for treelike graphs. Among its numerous applica- 
tions are computer vision problems, decoding of high 
performan ce turbo co des and many others, see iFrevI 
(fr998l : .McEliece et al\ (l998) . 



for cal cu lating loop corrections (Chertko v and Chernvak . 



2006 



2006al bl: Montanari and Rizzol 2005: Pa risi and Slanina 



Rizzo et all 2006 : Yedidia et ah . 200l[ ). however 



this problem is still unsolved. 

a. Regular Bethe lattice. The Bethe-Peierls approach 
gives an exact solution of the ferromagnetic Ising model 
in an uniform magnetic field on a regular Bet he lattice 
with a coordination number q ( Baxterl Il982l ). In this 
case, all vertices and edges on the lattice are equivalent, 
therefore, Mi = M and hij = h. From Eqs. (|57)) and 
(pO)) . we obtain 

M = i&TLh[(3H + Pqh], (63) 

tanh/?/i = tanh 13 J ianh[l3H + [3Bh]. (64) 



Hartmann and Weigj 120051: 
Pretti and Pelizzolal |2003[ ). 



(119981 : .McEliece et al\ (|1998) . Empirically it was found 
that it works surpris in gly g ood even for graphs with 
loops. lYedidia et al\ (|200l[ ) recently discovered that 
the belief-propagation algorithm actually coincides with 
the minimization of the Bethe free energy. This dis- 
covery renews interest in t he Bethe-Peierls appr o xima- 
tion and related in e thods 
iMooii and Kappenl 120051: 
The recent progress in the survey propagation algo- 
rithm, which was proposed to solve some difficult com- 
binatorial optimization problems, is a good example of 
interfere nce between computer s c ience and statistica l 
physics (iBraunstein and Zecchina ^ 2004 iMezard et all 
l2002t iMezard and R. Zecchinal . |2002D ~ 

In this section we give a physical interpretation of the 
belief-propagation algorithm in application to the Ising 
and other physical models on a graph. It enables us to 
find a general solution of an arbitrary physical model 
with discrete or continuous variables on a complex net- 
work. 
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We start with the Ising model on a graph. Consider a 
spin i. Choose one of its nearest neighbors, say, a spin 
j € N{i). We define a parameter iJ,ji{Si) as probability to 
find spin i in a state Si under the following conditions: (i) 
spin i interacts only with spin j while other neighboring 
spins are removed; (ii) an local magnetic field Hi is zero. 
We normalize ^ji{Si) as follows: X^s =±i ~ 
For example, if — 1 and 1) — 0, then the 

spin j permits the spin state Si — +1 and forbids the 
spin state Si = —1. In the same way, we define prob- 
abilities fini{Si) for other neighboring spins n G N{i). 
We assume that the probabilities fiji{Si) for all j G N{i) 
are statistically independent. Strictly speaking, this as- 
sumption holds true only in a treelike graph. For a graph 
with loops this approach is approximate. In the belief- 
propagation algorithm the probabilities fiji{Si) are tra- 
ditionally called messages (do not mix with the messages 
in the Bethe-Peierls approach). 

Let us search for an equilibrium state, using an iter- 
ation algorithm. We start from an initial set of non- 
equilibrium normalized probabilities {fJ-'fl^Si)}. Let us 
choose two neighboring vertices i and j. Using the ini- 
tial probabilities, we can calculate a probability to find a 
spin j in a state Sj under the condition that the state Si 
is fixed. This probability is proportional to the product 
of independent probabilities which determine the state 
Sj. First, we have the product of all incoming messages 
fi^hSj) from nearest neighboring spins n of j, except 



~nj 

i, because its state is fixed. This is Wn^N ^^nj i) ■ 
Second, we have a probabilistic factor exp{l3HjSj) due 
to a local field Hj. Third, we have a probabilistic factor 
e:iqy{pjijSiSj) due to the interaction between i and j. 
Summing the total product of all these factors over two 
possible states Sj = ±1, we obtain a new probability: 



S,=±l 



n 

neN{j)\i 



.(67) 

where A is a normalization constant. This equation is 
the standard update rule of the belief-propagation algo- 
rithm. Its diagram representation is shown in Fig. [511 
We assume that the update procedure converges to a 
fixed point /^"™(S'i) ^ji{Si). Sufficient conditions 
for convergence of the belief-propag ation algor it hm t o 
a unique fixed poi n t are derived in llhler et al\ HqoI); 
iMooii and Kappenl ( 20051 ). This fixed point determines 
an equilibrium state of the Ising model on a given graph. 
Indeed, we can write fJ.ji{Si) in a general form as follows: 

^ij^iS,) = eMf3hJ^S^)/ [2 cosh (3h^,], (68) 

where hji is some parameter. Inserting Eq. (j68p into 



Eq. (j67p . we obtain that the fixed point equation is ex- 
actly the recursion equation (pO)) in the Bethe-Peierls ap- 
proach. This demonstrates a close relationship between 
the belief-propagation algorithm and the Bethe-Peierls 
approximation. Local magnetic moments and the Bethe 
free energy are calculated in Appendix [B) 




FIG. 21 Diagram representation of the belief-propagation 
update rule. Arrows show incoming messages to a vertex j. 
A factor exp{f3HjSj) is shown as the closed circle. A solid line 
between j and i shows a factor exp{pJijSiSj). The double 
line is a new (outgoing) message from j to i. 



One can apply the belief-propagation algorithm to 
practically arbitrary physical model with discrete (Potts 
states) or continues (many component vectors) local pa- 
rameters Xi. Let us introduce local energies Ei{xi) and 
pairwise interaction energies Eij {xi ,Xj). A generalized 
fixed point equation is 



f^nj{Xj) — fJ-ji{Xi 

neN{j)\i 



(69) 

where A is a normalization constant. If Xi is a continuous 
variable, then we integrate over Xj instead of summing. 
In particular, one can show that for the Potts model this 
equation leads to the exact recursion equation (jE2p . 

The belief-propagation algorithm was recently ap- 
plied to study ferro- and antiferromagnetic, and 
spin-glass Ising models o n the configuration model 
( Mooii and Kappenl^ 2005f) and the Barabasi- Albert 
growing network (Ohkubo et 



3. Annealed network approach 

In this subsection we describe an improved mean-field 
theory which accounts for heterogeneity of a complex net- 
work. Despite its simplicity, usually this approximation 
gives surprisingly good results in the critical region. 

The main idea of the annealed network approach is to 
replace a model on a complex network by a model on a 
weighted fully connected graph. Let us consider the Ising 
model Eq. (|5^ on a graph with the adjacency matrix Uij. 
We replace aij by the probability that vertices i and j 
with degrees qi and Qj are connected. For the configura- 
tion model, this probability is qi qj/ziN, where Zi = (q). 
We obtain the Ising model on the fully connected graph: 



^an — ^ j^^j Jjjqiqj SiSj ^ ^ HiSi 



(70) 



1<J 



where qi plays the role of a "fitness" of vertex i. The re- 
sulting fully connected graph with these inhomogeneous 
fitnesses approximates the original complex network. As- 
suming that couplings Jij are finite and using exact equa- 
tion (j66p . we find magnetic moments: 



M, = tanh 



N 



(71) 
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Note that this set of equations is exact for the model 
Eq. ([70)1 in the hmit N ^ oo. For the ferromagnetic 
Ising model with = J in zero field, i.e., Hi — for all 
j, the magnetic moment Mi is given by 

A'h = tanh[/3Jg,M„], (72) 

where we introduced a weighted magnetic moment A/^ = 
{ziN)~^ J2j IjMj which is a solution of the equation: 



M^, = — V P{q)q tanh[/3 JgM^ 



(73) 



Equat ions ([72| and ([73|) were first derived by iBianconil 
( 20021 ) for the Barabasi- Albert network. They give an ap- 
proximate mean-field solution of the ferromagnetic Ising 
model on an uncorrelated random complex network. 

The effective model Eq. (|70p undergoes a contin- 
ues phase transition at a critical temperature Tcj J = 
Z2I Zl + 1 which approaches the exact critical tempera- 
ture, Eq. ([5^ . at Z2/Z1 ^ 1. The annealed network 
approach gives a correct critical behavior of the ferro- 
magnetic Ising model. It shows that at T near Tc the 
magnetic moment Afj cx QiM^ for not too large degree 
in agreement with the microscopic results in Sec. lVI.C.2l 
However this approach gives wrong results for a cooper- 
ative model on an original network with zij z\ — *■ I, i.e., 
near the birth point of the giant connected component. 
It predicts a non-zero Tc contrary to the exact one which 
tends to 0. At T = the annealed network approxima- 
tion gives the average magnetic moment M = \. The 
exact calculations in Sec. IVI.C.2I give M < 1 due to the 
existence of finite clusters with zero magnetic moment. 

The annealed network approximation was used for 
studying the ferromagnetic Isi ng model with d egree- 



degre e dependent couplings (jGiuraniuc et al\. 12005 
20061) and the random- field Ising model ( Lee et al. 
2006bl ). In Sees. IVlIIl and |X] we apply it to the ferro- 



magnetic XY and Kuramoto models, respectively. 



B. The Ising model on a regular tree 



The Ising model Eq. ([51]) on a regular tree can be 
solved by using the exact recursion method deve loped 
for Bethe lattices and Cayley trees ( Baxteil . Il982( ). Re- 
call that by definition, a Cayley tree is a finite tree while 
a Bethe lattice is infinite (see Sec. III.BI) . We will see 
that, even in the thermodynamic limit, thermodynamic 
properties of the ferromagnetic Ising model on a regular 
Cayley tree differ from those for a regular Bethe lattice. 



write a magnetic moment Mi of spin i and the partition 
function Z as follows: 

= ^ s^^""''' n aAS^), (74) 



S,=±l 



jeN{i) 



z = -'"^'^ n adSi). 



(75) 



s,=±i 



Here gji{Si) is a partition function of subtrees growing 
from vertex j, under the condition that the spin state Si 
is fixed: 

9,^{S^)^ eMPJ^JS^S,~ [3nj\,{{Sr^)]. (76) 

{S„=±l} 

Here 'Hj\i{{Sn\) is the interaction energy of spins, in- 
cluding spin J, on the subtrees except the edge [ij). The 
advantage of a regular tree is that we can calculate the 
parameters gji{Si) at a given vertex i by using the fol- 
lowing recursion relation: 



gji{Si) = Y e:xp[(3JijSiSj + (3HjSj] g,nj{Sj). 

Sj=±l meN{j)\i 

(77) 

Note that this equation is equivalent to Eq. ([S7)) at the 
fixed point within the belief-propagation algorithm. In 
order to shows this we introduce a parameter 



T 



ln[g,,(+l)/g,,(-l)] 



(78) 



and obtain Mi = tanh[(/3i7i -(- I3^,j hji)]. According to 
the Bethe- Peier Is approach in Sec. IVI.A.ll the param- 
eter hji has the meaning of the additional field (mes- 
sage) created by vertex j at nearest neighboring vertex 
i. These fields satisfy the recursion equation ([60|) . In 
turn, Eq. (pT|) determines messages which go out bound- 
ary spins of a given tree. Starting from the boundary 
spins and using Eq. ()60p . we can calculate one by one 
all fields hij on the Cayley tree and then find thermody- 
namic parameters of the Ising model. 



2. Spin correlations 

Using the recursion method, one can calculate the spin 
correlation function (SiSj) for two spins which are at a 
distance £ij from each other. We consider the general 
case when couplings Jy on a Cayley tree are arbitrary 
parameters. In zero field, {SiSj) is equal to a product of 
parameters tanh (3Jij along the shortest path connecting 
i to j: 



1. Recursion method 

Let us consider the ferromagnetic Ising model on a 
regular Cayley tree (see Fig. [T] in Sec. III.B]) . Any vertex 
can be considered as a root of the tree. This enables us to 



{S^Sj) = Y\_ tanh/3J„,m+i. 



(79) 



m— 



Here the index m numerates vertices on the shortest 
path, m = 0,1, ...iij, where m = corresponds to 
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vertex i and m = la corre s ponds to vertex j (iFaM 
119751: iHarrisl 119751 : iMukamell . ll974D . This function co- 
i ncides with a correla. tion function of an Ising spin chain 
(jBedeaux et aLl . ll970l) . and so spin correlations on a tree- 
like graph have a one-dimensional character. 

An even-spin correlation function {SiS2---S2n) can also 
be calculated and presen ted as a produ ct of pairwise cor- 
relation functions ( Fal3 . 11975I: iHarrisl 11975) . Odd-spin 
correlation functions are zero in zero field. 



3. Magnetic properties 



The free energy of the ferromagnetic Ising model with 
Jij = J > in zero magnetic field, H = 0, on a regular 




Cayley tree was calculated by lEggarteil ( 19741 ): 



FIG. 22 Exponent k versus T for the ferromagnetic Ising 
model on the regular Cayley tree with degree g = 3. The 
critical temperatures T; are shown in dotted lines. 



F = -TL ln[2cosh/3J]. 



(80) 



where L is the number of edges. Moreover this is the ex- 
act free energy of an arbitrary tree with L edges. F is an 
analytic function of T. Hence there is no phase transition 
even in the limit — ^ 00 in contrast to a regular Bethc 
lattice. A magnetization is zero at all temperatures ex- 

c ept r = 0. 

iMuller -Hartmann and Zittartd (|1974| ) revealed that 
the ferromagnetic Ising model on a regular Cayley tree 
with a branching parameter B = q — 1 > 2 exhibits a 
new type of a phase transition which is seen only in the 
magnetic field dependence of the free energy. The free 
energy becomes a nonanalytic function of magnetic field 
-ff > at temperatures below the critical temperature 
Tbp given by Eq. §5^): 



(81) 



F(T,H) = F(T,i7 = 0) + ^a„(r)ij2' 



1=1 



-A{T)H'^ + 0{H'' 



where a„(T) and A(T) are temperature dependent coef- 
ficients. The exponent k depends on T: a = lni3/ln[i?t], 
where t = tanh /3 J. It smoothly increases from 1 to 00 as 
temperature varies from to Tbp, see Fig. [221 F{T, H) 
is a continuous function of iJ at T = Tbp. All deriva- 
tives of F with respect to H are finite. Therefore, the 
phase transition is of the infinite order in contrast to 
the second order phase transition on a regular Bethe lat- 
tice (see Sec. IVI.A.ip . With decreasing T below Tbp, 
the singularity in F is enhanced. The leading nonan- 
alytic part of F has a form iJ^' |lnTr| at critical tem- 
peratures Ti given by an equation tB^^^/^^ = 1 which 
leads to Ti < T2 < . . . < Too = Tbp. The zero-field 
susceptibility x{T) diverges as (1 - t^S)-! at T = Ti. 
Note that this divergence does not means the appearance 
of a spontaneous magnetization. Magnetic properties of 
the Ising model on a regular Cayley t r ee were studied 
in jF alk, 1975; Heimb urg and Thomasl Il974 iMatsudal . 
ll974[lMelin et a/.. . ,19961: IStosic et alUl'd'd^ . 



Insight into the origin of the critical points Ti and 
Tbp may be gained by considering local magnetic prop- 
erties of the Cayley tree. Let us apply a small local 
magnetic field AiJ^ on a vertex i. Due to ferromagnetic 
coupling between spins, this field induces a magnetic mo- 
ment AA^(i) = l3V(i)iS.Hi in a region around i, where 
V{i) is a so-called correlation volume which determines 
a size of likely ferromagnetic correlations around i (see 
Sec. IVI.C.4p . An exact calculation of V{i) shows that 
the correlation volume of the central spin diverges at 
T = Tbp in the infinite size limit N 00. The cen- 
tral spin has long-ranged ferromagnetic correlations with 
almost all spins except for spins at a finite distance from 
the boundary. The correlation volume of a boundary 
spin diverges at a lower temperature T = Ti < Tbp si- 
multaneously with the zero-field susceptibility xiT) — 
N~^J2iP^{'^)- Therefore long-ranged spin correlations 
cover the whole system only at T < Ti. 

A specific structure of the Cayley tr ee leads to the exis - 
tence of numerous metastable states ( Melin et all . Il996l ) 
which do not exist on a Bethe lattice. These states have 
a domain structure (see Fig. [^5)1 and are stable with re- 
spect to single-spin fiips. In order to reverse all spins in a 
large domain it is necessary to overcome an energy bar- 
rier which is proportional to the logarithm of the domain 
size. Therefore, a state wit h large domains wi ll relax very 
slowly to the ground state. iMelin et al. I (tl996h found that 
a glassy-like behavior appears at temperatures below a 
crossover temperature Tg = 2J/ln[lnA^/lni?]. Notice 
that Tg ^ Q as, N ^ 00. However, Tg is finite in a finite 
Cayley tree. Even if N is equal to Avogadro's number 
6.02 X 10^3, we obtain Tg « 0.46 J at q = 3. For compari- 
son, Tbp « 1.8 J and Ti « 1.1 J. Large domains of flipped 
spins may arise at T < Tg. This leads to a non-Gaussian 
form of the magnetization distribution. 



C. The ferromagnetic Ising model on uncorrelated networks 

Here we show how strong is the influence of network 
topology on the critical behavior of the ferromagnetic 
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FIG. 23 Domains of flipped spins in the ferromagnetic Ising 
model on a regular Cayley tree. Filled and open circles rep- 
resent spins up and down. Double lines shows "frustrated" 
edges connecting antiparaUel spins. 



average magnetic moment is 

q m — 1 m—1 

(83) 

The replica trick (jLeone et al. I. I2n02f ) leads to the same 
equations (see Appendix ICj). 



2. Phase transition 



Ising model. We will see that when increased network 
heterogeneity changes the critical behavior (the ferro- 
magnetic phase transition becomes less sharp) and si- 
multaneously increases the critical temperature. We also 
discuss spin correlations and finite-size effects. 



1. Derivation of thermodynamic quantities 

The microscopic theory of the ferromagnetic Ising 
model on uncorrelated random netw orks was developed 
by usin g the exact recursion method ( Dorogovtsev et all . 
l2002bD . which is equivalent to the Bethe-P e ierls a pprox- 
imation, and the replica trick ( Leone et all |206^ . 

We consider the ferromagnetic Ising model, Eq. 
with couplings = J > in uniform magnetic 
field Hi — H within the Bethe-Peierls approach (see 
Sec. IVI.A.ip . In this approach, a thermodynamic state 
of the model is completely described by additional fields 
(messages) created by spins. In a complex network, due 
to intrinsic heterogeneity, the fields are random parame- 
ters. We introduce a distribution function "^{h) of mes- 
sages hij-. '^{h) = i^/Nzi)J2i.j ^{h - hij), where Nzi 
is the normalization constant. If we assume the self- 
averageness, then, in the limit N oo, the average over 
a graph is equivalent to the average over a statistical net- 
work ensemble. 

A self-consistent equation for ^'(ft.) follows from the 
recursion equation ((60| (see also Fig. [20] in Sec. IVI.A.ip : 



P{q)q 

zi 



S h-Tt&nh-^ 



tanh/3J x 



9-1 



9-1 



tanh(/3H + /5^ Y[^{h,n)dh^. (82) 



This equation assumes, first, that all incoming messages 
{hm} are statistically independent. This assumption is 
valid for an uncorrelated random network. Second, an 
outgoing message h is sent along a chosen edge by a ver- 
tex of degree q with the probability P{q)q/zi . If we know 
"^{h), we can find the free energy and other thermody- 
namic parameters (see Appendix For example, the 



In the paramagnetic phase at zero field H ~ 0, equa- 
tion ([5^ has a trivial solution: '^{h) = S{h), i.e., all mes- 
sages are zero. A non-trivial solution (which describes a 
ferromagnetically ordered state) appears below a critical 
temperature T^: 



Tc = 2 J/ In 



Z2 + Zi 
Z2 - Zi 



(84) 



This i s the exact result for an uncorrelated random net- 
work ( Dorogovtsev et ail . l2002bl : iLeone 

The critical temperature can be found from a 
"naive" estimate. As we have noted in Sec. IVI.A.ll the 
critical temperature Tbp, Eq. (|65p . is determined by the 
branching parameter rather than the mean degree. In 
a complex network, the branching parameter fluctuates 
from edge to edge. The average branching parameter B 
may remarkably differ from the mean degree zi . For the 
configuration model, inserting the average branching pa- 
rameter B = Z2/Z1 into Eq. ([GS)) . we obtain Eq. ([84)1 . If 
the parameter Z2 tends to zi, then Tc 0. It is not 
surprising, because at the percolation threshold we have 
Z2 — zi, and the giant connected component disappear. 

A general analytical solution of Eq. (|82|) for the dis- 
tribution function "^{h) is unknown. A correct critical 
behavior of the Ising model at T near Tc can be found 
by using an "effective medium" approximation: 



9-1 



Y,h„^~iq-'^)h + Oiq'/^), 



(85) 



where h = j h'^{h)dh is the average field which can be 
found self-consistently (jPorogovtsev et al\ . l2002b[ ) . This 
approximation takes into account the most "dangerous" 
highly connected spins in the best way. The ansatz 
(l85l) is equivalent t o the approximation '^[h) ^ S{h~ h) 
( Leone et aZ.l . l2003 ) . At lower temperatures a finite width 
of ^'(/i) becomes important. 

The ferromagnetic Ising model on uncorrelated ran- 
dom networks demonstrates three classes of universal 
critical behavior: 

(i) the standard mean-field critical behavior in net- 
works with a finite fourth moment ^9^) (scale- 
free networks with the degree distribution exponent 
7 > 5); 
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TABLE I Critical behavior of the magnetization M, the specific heat 5C, and the susceptibility x in Ising model on 
networks with a degree distribution P{q) ~ for various values of exponent 7. r = 1 — T /T^. 





M 


<5C(r < T,) 


X 


7 > 5 


^1/2 


jump at Tc 




7 = 5 




l/lnr"' 




3 < 7 < 5 


T-l/(7-3) 


^(5-7)/(7-3) 




7 = 3 


e-2T/(<j> 


y2g-4T/<q> 




2 < 7 < 3 


y-l/{3-7) 


y-{7-i)/(3-7) 





(ii) a critical behavior with non-universal critical ex- 
ponents depending on a degree distribution in net- 
works with divergent {q^), but a finite second mo- 
ment (g^) (scale- free networks with 3 < 7 < 5); 

(iii) an infinite order phase transition in networks with 
a divergent second moment (9^), but a finite mean 
degree (g) (scale- free networks with 2 < 7 < 3). 

The corresponding critical exponents (M ~ r'', 5C ~ 
T^", X ~ ''"~^) are reported in the Table|Tl The evolution 
of the critical behavior with increasing heterogeneity is 
shown schematically in Fig. [24l Notice that the Ising 
model on a regular random network demonstrates the 
stand ard mean-field c ritical behavior in the infinite size 
limit (|Scalettail . [l99lh . The corresponding exact solution 
is given in Sec. IVI.A.l.al 

The conventional scaling relation between the critical 
exponents takes place at 7 > 3: 



o 



a -f 2/3 + 7 = 2. 



(86) 



Interestingly, the magnetic susceptibility x has a uni- 
versal critical behavior with the exponent 7 = 1 when 
(g^) < 00, i.e., at 7 > 3. This agrees with the scahng 
relation 7/1/ = 2 — if we insert the standard mean-field 
exponents: 1^ — 1/2 and the Fisher exponent = (see 
Sec. IIX.B|) . When 2 < 7 < 3, the susceptibility x 
a paramagnetic temperature dependence, x ^ ^/T, at 
temperatures T > J despite the system is in the ordered 
state. 

At T < Tc the ferromagnetic state is strongly heteroge- 
neous because the magnetic moment Mi fluctuates from 
vertex to vertex. The ansatz Eq. ((85)) enables us to find 
an approximate distribution function of Mf. 



Y{M) 



1 ^ 



Mi 



P{q{M)) 



(87) 



where the function q{M) is a solution of an equation 

M{q) = tanh[/3ft,g]. Near Tc, low-degree vertices have 

1/2 

a small magnetic moment, M{q) ^ q\Tc — T\ ' <^ 1, 
while hubs with degree g > T/ft, ^ 1 have M(g) ~ 1. 
The function Y{M) is shown in Fig. [25l Note that the 
distribution of magnetic moments in scale-free networks 
is more inhomogeneous than in the Erdos-Renyi graphs. 
Moreover Y{M) diverges at M — > 1. A local magnetic 
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FIG. 24 Schematic representation of the critical behavior of 
the magnetization M (dotted lines) , the magnetic susceptibil- 
ity X (dashed lines), and the specific heat C (solid lines) for 
the ferromagnetic Ising model on uncorrelated random net- 
works with a degree distribution P(g) ~ q (a) 7^1, 
the standard mean-field critical behavior. A jump of C dis- 
appears when 7^5. (b) 4 < 7 ^ 5, the ferromagnetic phase 
transition is of second order, (c) 3 < 7 ^ 4, the transition 
becomes of higher order, (d) 2 < 7 ^ 3, the transition is of 
infinite order, and Tc —> 00 as A'' ^ cxd. 



moment depends on its neighborhood. In particular, a 
magnetic moment of a spin, neighboring a hub may dif- 
fer from a moment of a spin surrounded by low-degree 
vertices. Studies of these correl ations are at the very 
beginning ( Giuraniuc et "aLl. l2006D . 

In the ground state (T = 0, If = 0), an exact distri- 
bution function '^{h) converges to a function with two 
delta peaks: 



*(/i) = x&(h) + (1 - x)8{h - J), 



where the parameter x is determined by an equation de- 
scribing percolation in networks (see Sec. lIII.B.ip . Equa- 
tion (|88p tells us that in the ground state, spins, which be- 



33 



10- 

1 

I 
>- 

0.01 
0.001 




0.4 0.6 
M 



FIG. 25 Distribution function Y{M) of magnetic moments 
M in the ferromagnetic Ising model on the Erdos-Renyi graph 
with mean degree zi = 5 (dashed line) and scale-free graphs 
with 7 = 4 and 3.5 (solid and dotted lines) at T close Tc, 
l3h = 0.04. 



long to a finite cluster, have zero magnetic moment while 
spins in a giant connected component have magnetic mo- 
ment 1 because non-zero fields acts on these spins. The 
average magnetic moment is Af = 1 — J^q P{q)x'^- This 
is exactly the size of the giant connected component of 
the network. 



3. Finite-size effects 

When 2 < 7 ^ 3, a dependence of Tc on the size N is 
determined by the finite-size cutoff qcut{N) of the degree 
distribution in Sec. III. E. 41 We obtain 



Tc{N) 



zi In TV 



(7-2)^zig,\7j(jV) 
(3-7)(7-l) ' 



at 7 = 3, (89) 
at 2 < 7 < 3(90) 



(iBianconil . 120021 : iDorogovtsev et all l2002bl : iLeone et all . 

These estimates agree wit h the numerica l simula- 
tions oflAlcksicjuk et al. (2002): [Herrerol (|2004l ). Notice 
that Herrero used the cutoff q^nt (N) ~ N^/^ which leads 
to Tc ~ with the exponent z = (3 — 7)77. 



4. Ferromagnetic correlations 

Let us consider spin correlations in the ferromagnetic 
Ising model in the paramagnetic state. Recall that the 
correlation length ^ of spin correlations in the Ising model 
on a finite-dimensional lattice diverges at a critical point 
of a continuous phase transition. In contrast, in an 
uncorrelated random complex network, the correlation 
length ^ is finite at any temperature. Indeed, according 
to Eq. dTll), the correlation function C{£) = (S^Sj) de- 
cays exponentially with distance £ = iij: C{£) — e^^l^, 
where the coherence length ^ = 1/ |lntanh/?J| ^ at 
non-zero temperature. Moreover, spin correlations have 
a one-dimensional character despite a complex network 
is an infinite-dimensional system. Strictly speaking, this 



is valid at distances £ < £{N) '-^ In when a network is 
treelike. 

In complex networks, the so called correlation vol- 
ume rather than ^ plays a fundamental role (see also 
Sec. lIII.B"3)) . We define a correlation volume V{i) around 
a spin i as follows: 



V{i) 



N 

i=i 



{SiSj 



(91) 



It determines the size of likely ferromagnetic fluctuations 
around the spin. In the paramagnetic phase, V{i) is ex- 
pressed through local network characteristics: V{i) = 
Sfco -^^l*)^^; where t = tanh/3J, and Zi{i) is the number 
of vertices which are at a distance £ from vertex i, and 
zo{i) = 1. 

It is obvious that a correlation volume around a high 
degree vertex (hub) is larger than the one around a poorly 
connected vertex. In a scale-free network, hubs may form 
a highly conn e cted c luster (the rich-club phenom enon 
(|Colizza et al\ . 120061 : IZhou and Mondragonl [2001)). A 
region of likely ferromagnetic correlations around the 
rich-club may be very large. It grows with decreasing T, 
absorbing small clusters of correlated spins. The Erdos- 
Renyi network is more homogeneous than a scale-free 
network with the same average degree. At high temper- 
atures there are many small clusters of ferromagnetically 
correlated spins. With decreasing T small clusters merge 
together, forming larger clusters. 

The average correlation volume V is related with the 
total magnetic susceptibility: 



V 



N 00 

i=i 1=0 



(92) 



where zi is the average number of €-th nearest neighbors 
of a vertex on a given network: Zi = zi{i). The 

average correlation volume V diverges as In N in the crit- 
ical point of a continuous phase transition. The condition 
of divergence of the series in Eq. ((92l) leads to the equa- 
tion: B tanh (3c J — 1, where B = lim£^oo liniAr_^oo[-Z£]^^^ 
is the average branching parameter of the network. This 
criterion for the criti cal point is valid for any treelike 
network ( Lvonsl Il989l ) , including networks with degree- 
degree correlations, growing networks etc. B = 1 corre- 
sponds to the point of the birth of the giant connected 
component. At i? < 1 a network consists of finite clus- 
ters, the correlation volume is finite at all T, and there 
is no phase transition. 

Using Eq. ([5^ . we can calculate x in the paramag- 
netic phase. In the configuration model of uncorrelated 
random networks, we have Zf, = z\{z-2, j z\)^^^ . This gives 



Tx = y = 1 



So X diverges as |T — ^. 



Z\t 



1 — Zltj Z\ 



(93) 
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Equation ([79)1 for the correlation function (SiSj) is not 
valid for scale-free networks with 2 < 7 < 3 due to nu- 
mero us loops. How do spin c orrelations decay in this 
case? iDorogovtsev et all ([2005) found that in these net- 
works the pair correlation function (SiSj) between the 
second and more distant neighbors vanishes in the limit 
N 00. Only pair correlations between nearest neigh- 
bors are observable in this limit. 



5. Degree-dependent interactions 



iGiuraniuc et aj ] liooi, Hooi) studied analytically and 
numerically a ferromagnetic Ising model on a scale-free 
complex network with a topology dependent coupling: 
Jij = J z'l'^ {qiqj)^ ^ , where a constant J > 0, /j, is a tun- 
able parameter, qi and qj are degrees of neighboring ver- 
tices i and j. The authors demonstrated that the critical 
behavior of the model on a scale- free network with degree 
distribution exponent 7 is equivalent to the critical be- 
havior of the ferromagnetic Ising model with a constant 
coupling J on a scale-free network with renormalized de- 
gree distribution exponent 7' = (7— — /i). Therefore 
the critical exponents can be obtained, replacing 7 by 7' 
in Table H] Varying /i in range [2 — 7,1] allows us to 
explore the whole range of the universality classes repre- 
sented in Table [D For example, the ferromagnetic Ising 
model with = J on a scale-free network with 7 = 3 
undergoes an infinite order phase transition while the 
model with the degree dependent coupling for ^ ~ 1/2 
undergoes a second order phase transition with the crit- 
ical behavior corresponding to 7' = 5. 



D. The Ising model on small-world networks 

The phase transition in the ferromagnetic Ising model 
on small-world networks strongly resembles that in the 
percolation problem for these nets. Sec. IIII.GI This sys - 
tem was ex t ensive l y studied by Barrat and Weigtl ( 2000) , 
iGittermanI (|2000l ). iP^kalskil (l200l|), and many other re- 
searchers. Here we mostly discuss small- world networks 
based on one-dimensional lattices, with a fraction p of 
shortcuts. Let us estimate the critical temperature Tdp) 
assuming for the sake of simplicity only nearest-neighbor 
interactions in the one-dimensional lattice. The reader 
may easily see that if p is small, this network has a lo- 
cally tree-like structure. At small p, the mean branching 
parameter in this graph is i? = 1 + cp + 0{p^), where c 
is some model dependent constant. Substituting B into 
Eq. we arrive at 
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(94) 



where J is the ferromagnetic coupling. iBarrat and Weigtl 
(I2000D arrived at this result using th e replica trick. Ex- 
act calculations of lLopes et al. I (|2004fl confirmed this for- 
mula. 



Far from the critical temperature, the thermodynamic 
quantities of this system are close to those of the d- 
dimensional substrate lattice. However, in the vicinity of 
the critical temperature the ordinary mean-field picture 
is valid. Two circumstances naturally explain these tra- 
ditional mean-field features, (i) In the interesting range 
of small p, the small-world networks effectively have a 
locally tree-like structure (short loops due the lattice are 
not essential) . (ii) The small- world networks have rapidly 
decreasing degree distributions. As we have explained, 
this architecture leads to the traditional mean-field pic- 
ture of critical phenomena. The region of temperatures 
around Tdp), where this r nean-field picture i s realized, 
is narrowed as p decreases. iLopes et al\ ( 2004[ ) obtained 
the specific heat as a function of temperature and p and 
showed that its jump at the critical po i nt ap proaches 
zero as p — > 0. iRov and Bhattacharied ( 2006t) demon- 
strated numerically that the Ising model on the Watts- 
Strogatz network is self- averaging in the limit TV — > 00, 
i.e., the average over this ensemble is equivalent to the 
average over a single Watts-Strogatz network. With in- 
creasing network size N, the distributions of the magne- 
tization, the specific heat and the critical temperature of 
the Ising model in the ensemble of different realizations 
of the Watts-Strogatz network approach the i5-function. 
The size dependence of these parameters agrees with the 
finite scaling theory in Sec. IIX.BI 

iHastingd (120031 ) investigated the Ising model on the 
d-dimensional small-world. He found that for any d, 
the shift of the critical temperature is Tc{p) — Tdp = 
where 7 is the susceptibility exponent at 



P 



1/7 



0) 

p = 0, x{T,P = 0) ~ |r - TdQ)\~"'. Compare this shift 
with the similar shift of the percolation threshold in the 
same network, Sec. | III.GI Simulations of lHerrerol (j200 j ): 
IZhang and Novotnvl (|2006i) confirme d this p rediction. 

In their simulations, IJeong et al\ llooi) studied the 
Ising model with specific interactions placed on the ordi- 
nary one-dimensional small-world network. In their sys- 
tem the ferromagnetic interaction between two neighbor- 
ing spins, say, spins i and j, is \i — \i — i\ is a 
distance measured along the chain. Surprisingly, a phase 
transition was revealed only at a = 0, no long-range 
order f or ct > was ob served at any non-zero temper- 
ature. IChatteriee and Se n (2006) performed numerical 
simulations of the ferromagnetic Ising model placed on 
a one-dimensional small-world network, where vertices, 
say, i and j , are connected by a shortcut with probabil- 
ity ~ |i — (Kleinberg's network, see Sec. III.ip . They 
observed a phase transition at least at a < 1. In both 
these studies, the small sizes of simulated networks made 
difficult to arrive at reliable conclusions. On the other 
hand, these two systems were not studied analytically. 



E. Spin glass transition on networks 

Despite years of efforts, the understanding of spin 
glasses is still incomplete. The nature of the spin- 
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glass state is well understood for the infinite-range 
Sherr i ngton-Kirkpa t rick model ( Binder and Youna . 
119861 : iMezarde^ a/1 Il987f ). The basic property of the 
spin-glass model is that a huge number of pure thermo- 
dynamic states with non-zero local magnetic moments 
Mi spontaneously emerge below a critical temperature. 
This corresponds to the replica symmetry breaking. 

Investigations of a spin-glass Ising model on treelike 
network s began very soon afte r the discovery of spin 
glasses. IViana and Bravl ( 19851 ) proposed the so called 
dilute Ising spin-glass model which is equivalent to the 
Ising model on the Erdos-Renyi gra ph (the reader will 
find a review of early investigations in lMezard and Parisil 
Most of studies considered a spin-glass on ran- 
dom regular and Erdos-Renyi networks. A spin-glass on 
the Watts-Strogatz and scale-free networks only recently 
drew attention. 

Here we first review recent studies of the spin-glass 
Ising model on complex networks. Then we consider 
a pure antiferromagnetic Ising model, which becomes a 
spin-glass when placed on a complex network, and discuss 
relationships of this model with famous NP-complete 
problems (MAX-CUT and vertex cover). 



1. The Ising spin glass 

The spin-glass state arises due to frustrations. The na- 
ture of frustrations in the Sherrington-Kirkpatrick model 
and a spin-glass model on a finite dimensional lattice is 
clear. On the other hand, for an uncorrelated random 
network, the nature of frustrations is not so clear because 
such a network has a treelike structure in the thermody- 
namic limit. How do frustrations appear in this case? 
In order to answer this question we recall that locally 
tree-like networks usually have numerous long loops of 
typical length 0(ln A^), see Sec. III.Gl It turns out that 
frustrations in a network are due to these long loops. 

Two main methods are used to study the spin-glass 
Ising model on a random net work. These are the replic a 
trick and the cavity method ('Meza rd and Parisil . l200lt l. 
Early investigations of a spin glass on a Bethe lattice 
assumed that there is only one pure thermodynamic 
state, and the replica symmetry is unbroken. This 
assumption led to unphysical results such as, for ex- 
ample, a negative specific heat. The order parame- 
ter of the Sherrington-Kirkpatrick model is an over- 
lap (SaSp) between spins of two replicas a and (3. 
The spin-glass Ising model on a random network re- 
quires r nulti-spin overlaps (SnSftS~f ) . (SnSaSryS/j) and 
higher (iGoldschmidt and Dominicia. 19901: Kim et aH . 



120051 : iMottishawl . Il987l: IViana and Bravl Il985l ). This 
makes this model more complex. 

Many evidences have been accumulated indicating 
that a spin-glass state may exist in the spin-gla s s Isin g 
model on a Bethe lattice ( Mezard and Parisil . l200lh . 
It means that this model has many pure thermody- 
namic states at low temperatures. In order to obtain 



a complete description of a spin-glass state it is nec- 
essary to solve the recursion equations (pD]) and find 
the distribution function 'i'a{h) of the messages for ev- 
ery pure state a. It is a difficult mathematical prob- 
lem which is equivalent to search for a solution with 
replica symmetry breaking. In order to find an ap- 
proximate solution, a one step replica-sy mmetry break- 
ing approximation was developed d Castellani et all 120051 : 
iMezard and Parisil . I2OOII : iPagnani era/.l . l2003f) . This ap- 
proximation assumes that a space of pure states has a 
simple cluster structure (a set of clusters). Numerical 
simulations of the spin-glass Ising model on a random reg- 
ular network demonstrated that this approximation gives 
better results than the replica symmetric solution. A sim- 
i lar result was obtained for the Watts-Strogatz network 
( Nikoletopoulos et all 12004 ). Unfortunately the space 
of pure states is probably more complex, and a solution 
with a complete replica symmetry breaking is necessary. 
The phase diagram of the Isin g spin glass on th e Erdos 



Renyi graphs was studi ed by Castellani aL (12005 ): 



jgOOOt) : iKwon and ThoulessI 



iKanter and Sompolinskv .. 

(|1988D . and lHase et al\ (|2006t) . The diagram looks like 
the phase diagram of the Sherrington-Kirkpatrick model. 
The exact critical temperature of the spin-glass transi- 
tion, TgG, on a treelike complex network can be found 
without the replica trick. The criterion of this transition 
is the divergence of the spin-glass susceptibility: 



N N 



(95) 



Using Eq. ([7^ for the correlation function (SiSj), we 
find that XSG diverges at a critical temperature Tsg de- 
termined by the following equation: 



B / tanh2(/3sGJy)P(Jy)dJy = 1, 



(96) 



where B is the average branching parameter. 

If the distribution function P(Jij) is asymmetric, and 
the mean coupling J = J JijP{Jij)dJij is larger than a 
critical value, then a ferromagnetic phase transition oc- 
curs at a higher critical temperature than Tsg- The 
criterion of the ferromagnetic phase transition is the di- 
vergence of the magnetic susceptibility %: 



B j tanh{(3,J,j)P{J,j)dJ,j = 1. 



(97) 



In a multicritical point, we have Tc = Tsg- Equations 
(|M)) - (|57|) generalize the results obtained by the replica 
trick and others methods for regular random graphs, the 
Erdos-Renyi networks, and the static and configuration 
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b: ThoulessI 19861: Viana and Brav, 
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It is well-known that if J exceeds a critical value, the 
Sherrington-Kirkpatrick model at low temperatures un- 
dergoes a phase transition from a ferromagnetic state 
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into a so called mixed state in which ferromagnetism 
and spin-glass order coexist. The coexistence of ferro- 
magnetism and spin-glass order in the spin-glass Ising 
model on a random regular graph wit h degree q wa s 
considered bv.Castellani et all ( 20053 ; Tiers et all ( 2003( ). 
ICastellani et a/.l ( 2005 ) studied a zero-temperature phase 
diagram of the spin-glass Ising model with a random 
coupling Jij which takes values ±J with probabilities 
(1 ± p)/2. They found that at p exceeding a critical 
value Pcil) the spin-glass Ising model is in a replica sym- 
metric ferromagnetic state. For p < pdl), the replica 
symmetric state becomes unstable. The system goes into 
a mixed state with a broken replica symmetry. In par- 
ticular, for degree q — 3, pc{q = 3) 5/6. At q 1, 
Pc{q) ~ Inq/y/q. The one-step symmetry breaking so- 
lution showed that the mixed state exists in a range 
Pf < p < Pc{q)- At p < pf the ground sta te is a non- 



Pf < p < Pc[q)- At p < Of tne ground sta te is a r 
magnetic spin-glass state. iLiers etaH ( 20031 ) studied 



merically a spin-glass model with a Gaussian coupling 
Jij. They did not obs erve a mixed state in contrast to 



ICastellani e7a/] (|2005D . 

A strong effect of the network topology o n the spin- 
glass p hase transition was recently revealed bv lKim et all 
(|2005l ) in the Ising spin-glass model with Jij = ±J 
on an uncorrelated scale free network. These au- 
thors used a rep lica-symmetric perturbation approach of 
IViana and Br"^(|T985) . It turned out that in a scale- free 
network with 3 < 7 < 4, the critical behavior of the spin- 
glass order parameter at T near Tsg differs from the crit- 
ical behavior of the Sherrington-Kirkpatrick model and 
depends on 7. For the paramagnetic- ferromagnetic phase 
transition, a deviation from the standard critical behav- 
ior takes place at 7 < 5 similarly to the ferromagnetic 
Ising model in Sec. IVI.C.2I Critical temperatures of the 
ferromagnetic and spin-glass phase transitions approach 
infinity in the thermodynamic limit at 2 < 7 < 3. These 
transitions become of infinite order. 



2. The antiferromagnetic Ising model and MAX-CUT problem 

The antiferromagnetic (AF) Ising model becomes non- 
trivial on a complex network. As we will see, the model 
is a spin glass. We here also discuss a mapping of the 
ground state problem onto the MAX-CUT problem. 

Consider the pure AF model on a graph: 



E : 



J 



2 ^ 



where J > 0. The search for the ground state is equiva- 
lent to coloring a graph in two colors (colors correspond 
to spin states S = ±1) in such a way that no two adjacent 
vertices have the same color. Let us first consider a bi- 
partite network, that is a network without odd loops. It 
is obvious that this network is 2-colorable. The ground 
state energy of the AF model on a bipartite graph is 
£^0 = —JL, where L is the total number of edges in the 
graph. An uncorrelated complex network with a giant 




N- S 



FIG. 26 Partition of vertices in a graph into two sets con- 
sisting of S and N ~ S vertices, and K edges (solid lines) in 
the cut. Dotted lines show edges inside the sets. 



connected component cannot be colored with 2 colors 
due to numerous odd loops. So the ground state energy, 
Eq, of the AF model on a random graph is higher than 
— JL due to frustrations produced by odd loops. 

The ground state problem can be mapped to the MAX- 
CUT problem which belongs to the class of NP-complete 
optimization problems. Let us divide vertices of a graph 
(of N vertices and L edges) into two sets in such a way 
that the number K of edges which connect these sets is 
maximum, see Fig. 1261 If we define spins at vertices in one 
set as spins up and spins in the other set as spins down, 
then the maximum cut gives a minimum energy Eq of the 
AF model. Indeed, K edges between two sets connect 
antiparallel spins and give a negative contribution —JK 
into Eq. The remaining L — K edges connect parallel 
spins and give a positive contribution J(L — K). The 
ground state energy, Eq ^ J{L — 2K), is minimum when 
K is maximum. 

The maximum cut of the Erdos-Renyi graph with high 
probability is 



Kc = iaa^K = L/2 + AN^ + o{N) (99) 

for mean degree zi » 1 (jCoppersmith et all . |2004 
iKalapala and Moorel . l200d) . Here A is a constant with 
lower and upper bounds 0.26 < A< V\n2/2 w 0.42. Re- 
call that L = ziN/2. The estimation of Kc is given in 
Appendix iDl Thus the ground state energy is 



Eq/N = ~2JAy^. 



(100) 



The fraction of "frustrated" edges, i.e., edges which 
connect "unsatisfied" parallel spins, is (L — Kc)/L = 
1/2 — 2A/y/zi. Thus almost half of edges are frustrated. 
We found that this result is valid not only for classical 
random graphs but also for arbitrary uncorrelated ran- 
dom network. 

Interestingly, the lower bound of the ground state en- 
ergy Eq. (|100p is quite similar to the lower bound for the 
ground st ate en ergy of the random energy model intro- 
duced bv iDerrida (1981). This model approximates to 
spin-glass in any dimensions. Replacing the mean degree 
zi in Eq. (|100p by degree of a Z3-dimensional cubic lat- 
tice, 2D, we obtain the ground state energy of Derrida's 
model: Eq/N = ~jV2Dhi2. (We are grateful to M. 
Ostilli for attracting our attention to this fact.) 

Despite the seeming simplicity, the pure AF model 
on complex networks is not well studied yet. We as- 
sume that this model is the usual spin glass. On the 
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other hand, the analysis of lMooii and KappenI ( 20051 ) re- 
vealed an antiferromagnetic phase transition in the model 
on an uncorrelated random network at a critical point 
(Z2I z\) tanh /? J — 1, i.e., at the critical temperature Tbp 
in Eq. ([84]) . If this result is correct, then, as temperature 
decreases, the AF model may undergo a phase transition 
from an antiferromagnetic state into a spin-glass state. 
The structure of pairwise spin correlations in this sys- 
tem is non-trivial. The correlations between two spins 
separated by distance I are characterized by their aver- 
age value C{t) = z'[^J2ij (SiSj) Sg^e^.. We expect that 
at least for locally tree-like networks, the spin correla- 
tions are antiferromagnetic at all distances smaller than 
the mean intervertex separation J{N). These correla- 
tions should be present in the spin-glass phase and even 
in some range of temperatures above the spin-glass tran- 
sition. Antiferromagnetic correlations of this kind were 
observ ed in numerical simulations by iBartolozzi et al\ 

(12 0061) 

iHolme et all ( 20031 ) used the antiferromagnetic Ising 
model to study the bipartivity of real-world networks 
(professional collaborations, on-line interactions and so 
on). In order to measure the bipartivity, they proposed 
to put the AF model on the top of the network and cal- 
culate a fraction of edges between spins with opposite 
signs in the ground state. We have explained that this 
procedure is equivalent to finding the maximum cut of 
the graph. The larger is this fraction the closer is the 
network to bipartite. Measuring bipartivity allows one 
to reveal the bipartite nature of seemingly one-partite 
networks. Note that only their one-mode projections are 
usually studied, while most of real- world networks are 
actually multipartite. 



3. Antiferromagnet in a magnetic field, the hard-core gas 
model, and vertex covers 

Here we discuss relations between an antiferromagnetic 
Ising model, the hard-core gas model and the vertex cover 
problem on classical random graphs. On complex net- 
works these problems are poorly studied. 



a. The vertex cover problem. This problem is one of the 
basic NP-complete optimization problems. A vertex 
cover of a graph is a set of vertices with the property that 
every edge of the graph has at least one endpoint which 
belongs to this set. In general, there are many different 
vertex covers of a graph. We look for a vertex cover of a 
minimum size, see Fig. [571 iWeigt and Hartman i (I2OOOD 
proposed a vivid picture for this problem: "Imagine you 
are director of an open-air museum situated in a large 
park with numerous paths. You want to put guards on 
crossroads to observe every path, but in order to econo- 
mize cost you have to use as few guards as possible." 

Let us find size of a minimum vertex cover of the Erdos- 
Renyi graph of N vertices, L = ziN/2 edges and mean 





FIG. 27 Vertex cover of a graph, a) Open circles form a 
minimum vertex cover of the graph. Every edge has at least 
one endpoint which belongs to the vertex cover. The closed 
circles form the maximum independent set of the graph, b) 
The complement of the same graph (we add the missing edges 
and remove the already existing edges). Closed circles form 
the maximum clique. 



degree zi. We denote the number of vertices in a vertex 
cover as Nyc — xN. The parameter x can be interpreted 
as the probability that a randomly chosen vertex is cov- 
ered, i.e., it belongs to the vertex cover. An edge can 
be between every pair of vertices with the same proba- 
bility. So the probability that a randomly chosen edge 
connects two vertices which do not belong to the ver- 
tex cover is (1 — x)'^. With the conjugate probability 
1 — (1 — x)^ = 2a;(l — x), an edge has at least one covered 
endpoint. There are (^ ) ways to choose N^c vertices 
from N vertices. Only a small fraction of the partitions, 
[2a;(l — x)]^, are vertex covers. Thus the number of pos- 
sible vertex covers is 
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Using the estimate Eq. (|D3p . we obtain 



(101) 



E{x) = -{l-x)ln{l-x)-x\iix+^\n[2x{l~x)]. (102) 

The threshold fraction Xc is determined by the condition: 
E{xc) = 0. It gives Xc{zi) « 1 — 21nzi/zi -I- 0(l n In zi) 
at Zl ^ 1. The exact asymptotics was found bv iFriezg 
(I1990D : 



2 1 

Xc{zi) = 1 (lnzi-lnlnzi-ln2 + l)+o( — ). (103) 

Zl Zl 

At X < Xc, with high probability there is no vertex cover 
of size xN < XcN , while aXx > Xc there are exponentially 
many different covers of size xN > XcN . The appearance 
of many vertex covers looks like a phase transition which 
occurs at the threshold parameter x = Xc- 

The exact threshold Xc{zi) and the number of mini- 
mum vertex covers were calculated for the Erdos-Renyi 
graph by using a statistical mechanics analysis of ground 
state properties of a hard-core model (see below) and the 
replica method. The replica symmetric solution gives an 
exact result in the interval 1 < zi ^ e: 



Xc{zi) = 1 



2W{zi)+W{zif 
2zi 



(104) 



where W{x) is the Lambert-function defined by an equa- 
tion VFexpPF = X ( Weigt and Hartmannl . 12000 ). see also 
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Weigt and ZW (2006)^ The same result was derived by 
Bauer and GolinelU (20"01al lb[). using the leaf algorithm. 
Note that the giant connected component of the Erdos- 
Renyi graph disappear at zi < 1. The presence of the 
replica symmetry indicates that in the interval 1 < zi ^ e 
the degeneracy of the minimum vertex covers is trivial in 
the following sense. One can interchange a finite num- 
ber of covered and uncovered vertices in order to receive 
another minimum vertex cover. Many non-trivial mini- 
mum vertex covers appear at mean degrees zi > e. The 
replica symmetry is broken and Eq. (|104p is not valid. For 
this case the threshold Xc{zi) and the degeneracy of the 
minimum vertex cover were calcul ated by using the one- 
step replica s ymme t ry br eaking in IWeigt and HartmannI 



step replica s ymme t ry pr eaKing m iweigt ana Jiartmanni 
(|2000Ll200lh : IZhoul (|2003l ). Minimum vertex covers form 
a single cluster at zi ^ e, while they are arranged in 
many clusters at zi > e. As a result, the typical running 
time of an algorithm for finding a vertex cover at zi ^ e 
is polynomial while the time grows exponentially wit h 
the graph size at zi > e (|Barthel and HartmaniiH2004l ). 

The vertex cover pro blem on correlated sc a le-fre e net- 
works was studied by IVazguez and WeigQ ( 20031 ). It 
turned out that increase of likewise degree-degree corre- 
lations (assortative mixing) increases the computational 
complexity of this problem in comparison with an uncor- 
related scale-free network having the same degree distri- 
bution. If the assortative correlations exceed a critical 
threshold, then many nontrivial vertex covers appear. 

Interestingly, the minimum vertex cover problem is 
essentially equivalent to another NP-hard optimization 
problem — the maximum clique problem. Recall that a 
clique is a subset of vertices in a given graph such that 
each pair of vertices in the subset are linked. In order 
to establish the equivalence of these two optimization 
problems, it is necessary to introduce the notion of the 
complement or inverse of a graph. The complement of a 
graph G is a graph G with the same vertices such that 
two vertices in G are connected if and only if they are not 
linked in G. In order to find the complement of a graph, 
we must add the missing edges, and remove the already 
existing edges. One can prove that vertices, which do not 
belong to the maximum clique in G, form the minimum 
vertex cover in G (see Fig. [27l) . 

A generalization of t he vertex cover prob l em to hyper- 
graphs can be found in ezard and Tarzial (|2007D . 



b. The hard-core gas model. Let us treat uncovered ver- 
tices as particles, so that we assign a variable v — 1 for 
uncovered and v = for covered vertices. Hence there 
are J^i Vi = N — N^c particles on the graph. We also in- 
troduce a repulsion between particles such that only one 
particle can occupy a vertex (the exclusion principle) . A 
repulsion energy between two nearest neighboring parti- 
cles is J > 0. Then we arrive at the so called hard-core 
gas model with the energy 



J 
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where aij are the adjacency matrix elements. If the num- 
ber of particles is not fixed, and there is a mass exchange 
with a thermodynamic bath, then we add a chemical po- 
tential /i > 0. This results in the Hamiltonian of the 
hard-core gas model: TC = E — fj, J^iLi ^i- 

In the ground state of this model, particles occupy ver- 
tices which do not belong to a minimum vertex cover. 
Their number is equal to {1 — Xc)N , where Xc is the frac- 
tion of vertices in the minimum vertex cover. The ground 
state energy is _Bo = because configurations in which 
two particles occupy two nearest neighboring vertices, are 
energetically unfavorable. In other words, particles oc- 
cupy the maximum subset of vertices in a given graph 
such that no two vertices are adjacent. In graph theory, 
this subset is called the maximum independent set (see 
Fig. I27p . Unoccupied vertices form the minimum vertex 
cover of the graph. Thus finding the minimum vertex 
cover (or equivalently, the maximum independent set) of 
a graph is equivalent to finding the maximum clique of 
the complement of this graph. 

The ground state of the hard-core model is degenerate 
if there are many minimum vertex covers (or equivalently, 
many maximum independent sets). The reader may see 
that searching for the ground state is exactly equivalent 
to the minimum vertex cover problem. 

c. Antiferromagnet in a random held. Let us consider 
the fo llowing antiferromagnetic Ising model (|Zhoul . l2003l 
I2005D : 



J 
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Here J > 0, Hi = —Jqi is a degree dependent local field, 
where qi is degree of vertex i. L is the number of edges 
in a graph. The negative local fields force spins to be in 
the state —1, however the antiferromagnetic interactions 
compete with these fields. 

Consider a spin Si surrounded by qi nearest neighbors 
j in the state Sj = —1. The energy of this spin is 



(107) 
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in any state Si — ±1. Therefore this spin is effec- 
tively free. Positions of "free" spins on a graph are not 
quenched. If one of the neighboring spins flips up, then 
the state Si = — \ becomes energetically favorable. 

Let us apply a small uniform magnetic field /i, < 
/i <C J. At T = 0, all "free" spins are aligned along /x, 
i.e., they are in the state -1-1. One can prove that the 
spins 5 = -|-1 occupy vertices which belong to the maxi- 
mum independent set, while the spins S — —1 occupy the 
minimum vertex cover of a given graph. For this let us 
make the transformation Si = 2vi — 1, where Vi =0,1 for 
spin states =Fl, respectively. Then the antiferromagnetic 
model Eq. (I106P is reduced to the hard-core gas model 
where the external field /i corresponds to the chemical 
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FIG. 28 Phase diagram of the antiferromagnetic Ising model 
Eq. pU6p at T = 0. P, F and M denote paramagnetic, fer- 
romagnetic and mixed (spin-glass) phases, respectively. At 
mean degree zi > e, in the mixed phase, ferromagnetism and 
spin-glass order coexist. 
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potential of the particles. The energy of the degenerate 
ground state is Ef) = 0. All these pure states have the 
same energy Eq ~ 0, the same average magnetic moment 
M = 1 — 2xc but correspond to different non-trivial min- 
imum vertex covers. 

The exact mapping of the AF model Eq. (|106p onto the 
vertex cover problem leads to the zero-temperature phase 
diagram shown in Fig. 1281 The model is in a paramag- 
netic state at small degree < zi < 1 because in this case 
the network is below the percolation threshold and con- 
sists of finite clusters. Above the percolation threshold, 
at 1 < zi < e, the ground state is ferromagnetic with an 
average magnetic moment M = 1 — 2a;c(zi), where Xc{zi) 
is given by Eq. (|104p . The replica symmetry is unbroken 
at zi < e. Many pure states appear spontaneously and 
the replica symmetry is broken at zi > e. In this case the 
AF model is in a mixed phase in which ferromagnetism 
and spin-glass order coexist. At zi ^ 1 the magnetic 
moment M is determined by Xc(zi) from Eq. (|103p . 



F. The random-field Ising model 

The random-field Ising model is probably one of 
the simplest models showing a dramatic influence of 
a quenched disorder (random fields) on a collective 
behavior of a system with an exchange interactio n 
(llmrv and Mal . ll975l :lL acour- Gavet and Toulousel . fl97l . 
Despite its simplicity, the random-field model was an ob- 
ject of intensive and controversial investigations during 
the last three decades. The energy of this model is 



E 



J 



where J > 0, iJ is a uniform field, and Hi is a random 
field. In most cases, the distribution function of the ran- 
dom field is either Gaussian, 
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or bimodal, 



]^5{H, - Ho) + ^S{H, + Ho). 
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FIG. 29 Phase diagram of the random-field model on the 
fully connected graph. For the Gaussian distribution, the 
phase transition from the para- (P) to ferromagnetic (F) phase 
is of second order in the T — a plane. For the bimodal distri- 
bution, there is a tricritical point (TCP) in the T — Hq plane. 
The phase transition is of second order (solid line) above TCP 
and first order (dashed line) below TCP. 



The parameters a and Hq characterize a strength of ran- 
dom fields. 

The search for the ground state of the random-field 
model on a graph is related with a famous optimiza- 
tion problem of a maximum fio w through the graph 
Picard and Ratli^ (|1975) ; see also lHartmann and Weigtl 



2005l )V This problem belongs to the class P, that is it 



may be solved in time bound by a polynomial in the 
graph size. 



1. Phase diagram 

The random-field model is exactly sol ved on the full 
connected graph (all - to-all interaction) (jAharonvl Il97i 
ISchneider and Pvttd . Il977[ ) . In this case we replace the 
coupling J hy J/N in Eq. (|108p . The average magnetic 
moment is 



M = y tanh[/3( JM + H + Hi)]PYiF{H,)dH, 
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For the Gaussian distribution, the phase transition from 
the para- to ferromagnetic state is a mean-field second 
order phase transition. Sufficiently strong random fields 
suppress the phase transition at cr > Uc = •/[2/7r]^^^, and 
the system is in a disordered state at all T. The phase 
diagram of the random-field model with the bi modal dis- 
tribution of random field is shown in Fig. 1291 iBruinsrnal 
(jl984 ) found that the random-field model with the bi- 
modal distribution on a regular Bethe lattice has a rich 
ground state structure. 



2. Hysteresis on a fully connected graph 

The random-field model demonstrates a peculiar hys- 
teresis phenomena at T = which may be relevant 
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for understanding out-of-equilibrium p henomena in many 
complex systems ( Sethna et aU [20011 ). 

We start with a physical picture of the hysteresis which 
is valid for any network. Let all spins be in the state 
— 1. This initial state corresponds to an applied field 
H = —oo. An adiabatic increase of the magnetic field 
results in a series of the so called discrete Barkhausen 
jumps (avalanches) of a finite size ( Perkovic et ai . 199^ 
ISethna all Il993f) . A spin avalanche can be initiated 
by a single spin flip. Indeed, if the total magnetic field 
H + Hi at vertex i becomes larger than the energy of the 
ferromagnetic interaction of the spin with neighboring 
spins, then the spin turns up. This spin flip can stim- 
ulate flips of neighboring spins, if they are energetically 
favorable. In turn the neighboring spins may stimulate 
flips of their neighbors and so on. As a result we observe 
an avalanche. If H is smaller than a critical field Hc{ct), 
then the average avalanche size is finite. At H = Hc{<j) 
a macroscopic avalanche takes place, and the magnetiza- 
tion has a jump AA/. 

The exact properties of the hysteresis on the fully 
conne cted graph at T = were found by ISethna et al\ 
(|l993l ). The dependence of the magnetization M on H 
along a hysteresis loop follows from Eq. (|llip : 



M 
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The analysis of this equation for the Gaussian distribu- 
tion of random fields shows that the critical field Hc{<t) 
is non-zero at small strengths a < ac- There is no hys- 
teresis at a sufficiently large strength of the random field, 
a > <7c = J[2/7r]^/^, see Fig. [301 The magnetization has 
a universal scaling behavior near the critical point (ctc, 



Mir, h) = \a-a,fG{h/\a-a,f') 
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where h = H ~ Hc{ac)- (3—1/2 and 6 = 3 are the 
mean-field critical exponents. G{x) is a scaling function. 

3. Hysteresis on a complex network 

Another approach applied to zero-temperature hys- 
teresis on the ran dom regular graph was developed by 
iDhar et~al. I (I1997D . Here we generalize this approach to 
the configuration model of an uncorrelated random net- 
work with a given degree distribution P{q). 

As above, we suppose that all spins are in the initial 
state — 1 at iJ = — cx). Then the applied field is adiabat- 
ically increased. Let P* be the conventional probability 
that if a spin at an end of a randomly chosen edge is 
down, then for the other end spin, it will be energetically 
favorable to flip up. P* satisfies the equation: 

^ ^ mq Y^f'i-^^ [pni ~ pr-'->n{H), 

(114) 
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FIG. 30 Hysteresis in the ferromagnetic Ising model with 
Gaussian random fields (magnetization M versus ff). (a) 
Fully connected graph; solid line, a = 0.5 < ctc; dashed line, 
a ^ (Jc. (b) Random regular network with degree g = 4: solid 
line, a = 1.7 < (Tc, dashed line, cr = 2 ^ a^- (c) Uncorrelated 
scale-free networks for a = 1.7: solid line, 7 > 4, (g) ~ 4; 
dashed line, 7 = 3, (q) ~ 4; dotted line, 7 = 2.2, (g) = 5.3. 



where q is vertex degree. The n-th term in the sum is the 
probability that n neighbors of a spin turn up simultane- 
ously with the spin while the other q — n—\ neighboring 
spins remain in the state —1. The parameter 



PnF{H,)dH, 
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-H+(q-2n)J 



is the probability to find a vertex with a random field 
Hi > —H+ {q — 2n)J. Knowing P* , we can calculate the 
fraction of spins which turn up at an applied field H: 



N^iH) = J2 m E ( M - pr->n{H). 

q n=0 ^ ^ 

(116) 

It gives the magnetization: M{H) = 2N^{H) - 1. Note 
that Eqs. pii)) and pTB]) resemble Eqs. §^ and §Q 
describing the fc-core architecture of networks. 

Hysteresis was only studied in detail for a random 
regular network (all vertices have the same degree, i.e., 
P{q) = <5g,fe), see Fig. [30l In this case there is hysteresis 
without a jump of the magnetization if the strength a of 
Gaussian random fields is larger than a critical strength 
Ctc, in contrast to the fully connected graph where hys- 
teresis disappears at ct > CTc- The critical field He of the 
magnetization jump docs not depend on g > 3. Monte 
Carlo simulations of the rando m-field mod e l on a ran- 
dom regular network made by iDhar et~al. con- 
firmed this analytical approach. A numerical solution of 
Eqs. pisp and (|116p shows that the random-field model 
on uncorrelated scale-free networks has a similar hystere- 
sis behavior (see Fig. . Note that the critical field He 
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depends on the degree distribution exponent 7 only when 
2 < 7 < 4. 

A similar hysteresis phenomenon was found nu- 
merically in the antiferromagnetic Ising model on 
growing scale-free and Erdos-Renyi networks within 
zero-temperature field -d riven dynamics of spins 
(iHovorka and Friedmanl . 120071 : iMalarz et all . 120071 : 
iTadic et all l2005f) . It was shown that the network 
topology influences strongly properties of hysteresis 
loops. In this model, it is the network inhomogeneity 
that plays the role of disorder similar to the random 
fields. 




FIG. 31 The d eterministic fully connected graph 
(|Costin et all 1 19901 '). which is equivalent to the asym- 
metric annealed network. The values of the Ising coupling 
are shown on the edges. 



4. The random-field model at T = 

Critical properties of the random-field model at T = 
on scale- free networks were st udied numerically and an- 
alytically bv lLee et al. I (I2OO6H) bv using a mean-field ap- 
proximation which is equivalent to the annealed network 
approximation in Sec. IVI.A.3I These authors found 
that a critical behavior near a phase transition from a 
disordered state into the ferromagnetic state depends 
on degree distribution exponent 7. If the distribution 
function of random fields is concave at iJ^ = (i.e., 
P^p{Hi = 0) < 0, similar to the Gaussian distribu- 
tion) then the spontaneous magnetization M emerges 
below a critical strength ac- M oc \(Jc — , where 
/3(7 > 5) = 1/2, /3(3 < 7 s; 5) = 1/(7-3). In the case of 
the convex distribution function, i.e., P^p{Hi = 0) > 0, 
the phase transition is of the first order at all 7 > 3. 
When 2 < 7 ^ 3, the random-field model is in the ferro- 
magnetic state for an arbitrary strength and an arbitrary 
distribution function of random fields. This effect is quite 
similar to the effect found in the ferromagnetic Ising and 
P otts model s in Se es. IVI.C.2I IVIll and |IX| • 

ISon et all ( 20061 ) proposed to use the random-field 
model as a tool for extracting a community structure 
in complex networks. In sociophysics, the random-field 
Ising model is used for describing the emergence of a col- 
lective opinion. 



very often results obtained in this way appear to be quali- 
tatively similar to conclusions for models on random net- 
works. Various graphs similar to those shown in Fig. fal- 
low one to effectively apply the real s pace renor malization 
group technique. For example, lAndrade and Hcrrmannl 
(|2005r ) studied the Ising model on the graph shown in 
Fig-EKc) — "the Apollonian network" — and observed fea- 
tures typical for the Ising model on random scale-free 
network with exponent 7 < 3. 

More interestingly, the Ising model on some determin- 
istic graphs shows the BKT-like sin gularities wh ic h was 
alre ady discovered in the 19 90s bv ICostin et al\ ( 1990l ) 
and lCostin and Cos tin' (1991 ). In networ k context, their 
model was studied in Bauer et al\ ( |2005l ). This network 
substrate is an asymmetric annealed network, which is 
actually an annealed version of the random recursive 
graph. Vertices are labelled i — 0, l,2,...,i, as in a 
growing network. Each vertex, say vertex i have a sin- 
gle connection of unit strength to "older" vertices. One 
end of this edge is solidly fixed at vertex i, while the 
second end frequently hops at random among vertices 
0, 1, ... ,1 — 1, which just means the specific asymmet- 
ric annealing. The resulting network is equivalent to the 
fully connected graph with a specific large scale inhomo- 
geneity of the coupling (see Fig. [?T|) . 

The ferromagnetic Ising model on this network is de- 
scribed by the Hamiltonian 



G. The Ising model on growing networks 

In this section we assume that a spin system on a grow- 
ing network approaches equilibrium much faster than the 
network changes, and the adiabatic approximation works. 
So we discuss the following circle of problems: a network 
is grown up to an infinite size and then the Ising model 
is placed on it. 



1. Deterministic graphs with BKT-like transitions 

As is natural, the use of deterministic graphs dramati- 
cally facilitates the analysis of any problem. Surprisingly, 
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where are local magnetic fields. The mean-field the- 
ory, exact for this Hamiltonian, indicates the presence of 
a phase transition in this system. Figure [32] shows an 
inhomogeneous distribution of the magnetization m{i) 
over the network. Only in the normal phase, without 
field, m{i) — 0. Otherwise, the oldest spin turns out 
to be strictly directed, m{i = 0) = 1, and the pro- 
file is non-analytic: m(i ) = 1 — const(z/t)^/"^. Ear- 
lier, ICoulomb and Bauerl (|2003t) observed a resembling 
effect studying a giant connected component in random 
growing networks. The full magnetization M (T) demon- 
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FIG. 32 The magnetization profile for tlie ferromagnetic Ising 
model on the graph shown in Fig. 1311 i labels vertices starting 
from the "oldest" one, and t is the network size. Curve 1 is 
valid both for T < Tc with an arbitrary homogeneous applied 
field H and for T > Tc, H ^ 0. Curve 2 describes the profile 
when an external field is applied to a single spin, while T > 
Tc- The arrow indicates the point of application of the local 
magnetic field. The mean magnetic moment of this vertex is 
very distinct from others. 



stratcs the BKT-kind behavior near the phase transition: 
M(T) ocexp(-lJI^). (118) 



Note that the BKT singularity, Eq. (jllSp . and the specific 
non-analyticity of m(i) at i — are closely related. 

The distribution of the linear response, 
dm{i)/dHj\H=Q, to a local magnetic field, which may 
be also called the distribution of correlation volumes, 
in this model is very similar to the size distribution of 
connected components in growing networks with the 
BKT-like transition. It has a power-law decay in the 
whole normal phase. Exactly the same decay has the 
distribution of correl ations dm{i)/dHj\H=o in this phase 
(iKhaieh et aZ.I . l2007f) . 

We may generalize the inhomogeneity of the inter- 
action in the Hamiltonian to a power law, oc 
with an arbitrary exponent. (For brevity, we omit the 
normalization — the sum of the coupling strengths must 
grow proportionally to the size of the network.) One may 
show that in this model the BKT-singularity exists only 
when a = 1. For a > 1, phase ordering is absent at 
any nonzero temperature as in the one-dimensional Ising 
model, and for < a < 1, there is a quite ordinary sec- 
ond order transition. 

Let us compare this picture with the well-studied ferro- 
magnetic Ising model for a spin chain with regular long- 
range interactions oc |«— (see, e.g.. lLuiiten and Blotd 
(|1997| )). In this model, (i) for a > 2, = 0, similarly to 
the one-dimensional Ising model; (ii) at a = 2, there is a 
transition resembling the BKT one; (iii) for 1 < a < 2, 
there is a transition at finite Tc. The reader may see that 
in both models, there exist boundary values of exponent 
a, where BKT-kind phenomena take place. In very sim- 
ple terms, these special values of a play the role of lower 
critical dimensions. (Recall that the BKT transitions in 



solid state physics occur only at a lower critical dimen- 
sion.) These associations show that the BKT singular- 
ities in these networks are less strange and unexpected 
t han one may think at first sight. 

iKhaieh et al. solved the q-state Potts model on 

this network and, for all g > 1 arrived at results quite 
similar to the Ising model, i.e., q — 2. Recall that q — 
1 corresponds to the bond percolation model, and that 
the traditional mean-field theory on lattices gives a first 
order phase transition if q > 2. Thus, both the first and 
the second order phase transitions transformed into the 
B KT-like one on this network. 

iHinczewski and Berkeil ( 20061 ) found another deter- 
ministic graph, on which the Ising model shows the BKT- 
like transition, so that this singularity is widespread in 
evolving networks with large-scale inhomogeneity. 



2. The Ising model on growing random networks 

There is still no analytical sol ution of the Ising mode l 
on growing random networks. lAleksieiuk et al T (I2002D 
and their numerous followers simulated the Ising model 
on the very specific Barabasi- Albert network, where 
degree-degree correlations are virtually absent. So, the 
resulting picture is quite similar to the Ising model on 
an uncorrelated scale-free network with degree distribu- 
tion exponent 7 = 3. In general, the growth results in 
a wide spectrum of structural correlations, which may 
dramatically change the phase transition. 

Based on known results for the percolation (the one- 
state Potts model), see Sec. lIII.Fl we expect the following 
picture for the Ising model on recursive growing graphs. 
If each new vertex has a single connection, the recursive 
graph is a tree, and so the ferromagnetic ordering takes 
place only at zero temperature. Now let a number of con- 
nections of new vertices be greater than 1, so that these 
networks are not trees, (i) If new vertices are attached 
to randomly chosen ones, there will be the Berezinskii- 
Kosterlitz-Thouless critical singularity, (ii) If the mech- 
anism of the growth is the preferential attachment, then 
the critical feature is less exotic, more similar to that for 
uncorrelated networks. 



VII. THE POTTS MODEL ON NETWORKS 

The Potts model is related to a number of outstand- 
i ng pro b lems i n statistic al and mathematical physics 
(|Baxteii Il982t IWul . Il982l ). The bond percolation and 
the Ising model are only particular cases of the p- 
state Potts model. The bond percolation is equiva- 
l ent t o one-state Potts mode l (Fortuin and Kastelevr] 
19721): iKastelevn and FortuinI (|T969l ). see also lLee et all 
2004g)). The Ising model is exactly the two-state Potts 
model. Here we first look at critical properties of the 
Potts model and then consider its applications for color- 
ing a random graph and for extracting communities. 
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A. Solution for uncorrelated networks 

The energy of the Potts model with p states is 

= - ^ X! Ji3'^''3^a,,aj ~ ^ (^q^,! , (119) 

where ba.^ = 0, 1 if a 7^ /3 and a = /?, respectively. Each 
vertex i can be in any of p states: ai = 1, 2, . . . ,p. The 
"magnetic field" H > distinguishes the state a = 1. 
The a-component of the magnetic moment of vertex i is 
defined as follows: 
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In the paramagnetic phase at zero magnetic field, Kl'f^ = 
for all a. In an ordered state m\"''^ ^ 0. 

Exact equations for magnetic moments of the Potts 
model on a treel ike complex netwo r k (see Appendix IE|1 
were derived bv iDorogovtsev et al\ ( 2004f l by using the 
recursion method which, as we have demonstrated, is 
equivalent to the Bethe-Peierls approximation and the 
belief-propagation algorithm . It was shown that the fer- 
romagnetic p-state Potts model with couplings (J^ = 
J > 0) on the configuration model has the critical tem- 
perature 



Tp = J/ In 
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where B = zijzx is the average branching parameter. 
Interestingly, Tp has different meanings for p = 1,2 and 
p ^ 3. In the case p — 1, the critical temperature Tp 
determines the percolation threshold (see Appendix IE)) . 
When p = 2, Tp is equal to the exact critical temperature 
Eq. (|84p of the ferromagnetic phase transition in the Ising 
model (it is only necessary to rescale J 2J). For 
p ^ 3, Tp gives the lower temperature boundary of the 
hysteresis phenomenon at the first order phase transition. 



B. A first order transition 

In the standard mean-field theory, the ferromagnetic 
Potts model with Jy = J > undergoe s a first order 
phase transition for all p ^ 3 ijWul . Il982l ). In order to 
study critical properties of the Potts model on a complex 
network, we need to solve Eq. (jE2[) which is very difficult 
to do analytically. An approximate solution based on 
the an satz Eq. ([55]) was obtained bv IDorogovtsev et all 
(I2004D . . t turned out that in uncorrelated random net- 



works with a finite second moment (g^) (which corre- 
sponds to scale-free networks with 7 > 3) a first order 
phase transition occurs at a critical temperature Tc if the 
number of Potts states p ^ 3. In the region Tp < T < 
two metastable thermodynamic states with magnetic mo- 
ments M = and M ^ coexist. This leads to hysteresis 
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FIG. 33 Magnetic moment M versus T for the ferro- 
magnetic Potts model on an uncorrelated scale-free network 
with degree zi — 10. Leftmost curves: 7 = 4; right- 
most curves, 7 = 3.5. Numeric al simulations and exact nu- 
merical solution (jEhrhardt and Marsili. 2005) are shown in 
crosses and solid lines. Dotted lines, an approximate so- 
lution (|Dorogovtsev et~al\ . 120041 '). Vertical lines, the lower 
temperature boundary Tp of the hysteresis region. From 
lEhrhardt and Marsilil (|2005l 'l. 



phenomena which are typical for a first order phase tran- 
sition. At T < Tp, only the ordered state with M 7^ is 
stable. 

When 7 tends to 3 from above, Tc increases while the 
jump of the magnetic moment at the first order phase 
transition tends to zero. The influence of the network 
heterogeneity becomes dramatic when 2 < 7 ^ 3 and 
the second moment (5^) diverges: instead of a first order 
phase transition, the p-state Potts model with p ^ 3 
undergoes an infinite order phase transition at the critical 
temperature Tc{N)/J « Z2/(zip) » 1, similarly to the 
Ising model in Sec. IVI.C.2I In the limit N — > 00, the 
Potts model is ordered at any finite T. 

lEhrhardt and Marsilil ( 20051 ) used a population dy- 
namics algorithm to solve numerically Eq. (|E2p for un- 
correlated scale-free networks. The exact numerical cal- 
culations and numerical simulations of the Potts model 
confirmed that a first order phase transition occurs 
at jP ^ 3 when 7 > 3. Some results obtained by 
lEhrhardt and Marsilil ( 20051 ) are represented in Fig. [551 
where they are compared with the approximate solution. 
As one could expected, the approximate solution gives 
poor results for vertices with small degree. For graphs 
with a large minimum degree (say qo — 10) the approxi- 
mate solution agrees well with the exact calculations and 
numerical simulations. 



A simple mean-field approach to the Potts model 
on uncorrelated scale - free networks was used by 
IM6 i and TurbanI (|2002 ). It s conclusions essent ially de- 
viate from the exact results. iKarsai et 'dl (l200(D studied 
the ferromagnetic large-p state Potts model on evolving 
networks and described finite-size scaling in these sys- 
tems. 
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C. Coloring a graph 

Coloring ran dom graphs is a remarkab le problem in 
combinatoric s (iGarev and Johnsonl . Il979t) and statisti- 
cal physics Given a graph, we want to 
know if this graph can be colored with p colors in such 
a way that no two neighboring vertices have the same 
color. A famous theorem states that four colors is sufR- 
cient to color a planar grap h, such as a political map 
( Appel and Hakeiil Il977al lbl). Coloring a graph is not 
only beautiful mathematics but it also has important ap- 
plications. Good examples are scheduling of registers in 
the central processing unit of computers, frequency as- 
signment in mobile radios, and pattern matching. Color- 
ing a graph is a NP complete problem. The time needed 
to properly color a graph grows exponentially with the 
graph size. 

How many colors do we need to color a graph? In- 
tuitively it is clear that any graph can be colored if we 
have a large enough number of colors, p. The minimum 
needed number of colors is called the "chromatic num- 
ber" of the graph. The chromatic number is determined 
by the graph structure. It is also interesting to find the 
number of ways one can color a graph. 

The coloring problem was extensively investigated for 
classical random graphs. There exists a critical degree Cp 
above which the graph becomes uncolorable by p colors 
with high probability. This transition is the so called 
p-COL/UNCOL transition. Only graphs with average 
degree zi = (q) < Cp may be colored with p colors. For 
larger zi we need more colors. 

In order to estimate the threshold degree Cp for the 
Erdos-Renyi graph, one can use the so-called first- 
moment method (annealed computation, in other words). 
Suppose that p colors are assigned randomly to vertices. 
It means that a vertex may have any color with equal 
probability 1/p. The probability that two ends of a ran- 
domly chosen edge have different colors is 1 — 1/p. We 
can color N vertices of the graph in p^ different ways. 
However only a small fraction (1 — of these con- 

figurations have the property that all L — ziN/2 edges 
connect vertices of different colors. Hence the number of 
p-colorable configurations is 



m{zi) - - l/p)^ = exp[NE{p)]. 



(122) 



If S(p) ^ 0, then with high probability there is at least 
one p-colorable configuration. At p ^ 1, this condition 
leads to the threshold average degree Cp ~ 2p\np — In p. 
T he exact t hresh old Cp ~ 2p\np — \np + o(l) was found 
bv lLuczakI (|l99ll ). see also lAchlioptas et all (|2005[ ). 

The coloring problem was reconsidered by meth- 
ods of statistical mechanics of disordered systems, and 
a comp lex structure of the co l orable phase was re- 
vealed (iBraunsteineit al. . 2003b : iKrzakala et al. I, 12004 
iMezard et all l2005t iMulet et all |2002| ). It was found 
that the colorable phase itself contains several different 
phases. These studies used the equivalence of this prob- 
lem to the problem of finding the ground state of the 



Potts model, Eq. (|119p . with p states (colors) and anti- 
ferromagnetic interactions Jij — ~J < in zero field. 
Within this approach, the graph is p-colorable if in the 
ground state the endpoints of all edges are in different 
Potts states. The corresponding ground state energy is 
E = 0. The degeneracy of this ground state means that 
there are several ways for coloring a graph. In the case of 
a p-uncolorable graph, the ground state energy of the an- 
tiferromagnetic Potts model is positive due to a positive 
contribution from pairs of neighboring vertices having the 
same color. 

It was shown that if the mean degree zi is sufficiently 
small, then it is easy to find a solution of the problem 
by using usual computational algorithms. In these algo- 
rithms, colors of one or several randomly chosen vertices 
are changed one by one. For example, the Metropolis 
algorithm gives an exponentially fast relaxation from an 
arbitrary i nitial set of vertex colors to a correct solution 
fS venson and Nordahll . Il999l ). On the other hand, for 
higher mean degrees (of course, still below Cp), these al- 
gorithms can approach a solution only in non-polynomial 
times — "computational hardness". The computational 
hardness is related to the presence of a hierarchy of nu- 
merous "metastable" states with a positive energy, which 
can dramatically slow down or even trap any simple nu- 
merical algorithm. 

The mentioned works focused on the structure of the 
space of solutions for coloring a graph. (A solution here 
is a proper coloring of a graph.) It was found that this 
structure qualitatively varies with the mean degree. In 
general, the space of solutions is organized as a set of 
disjoint clusters — "pure states". Each of these clusters 
consists of solutions which can be approached from each 
other by changing colors of only o{N) vertices. On the 
other hand, to transform a solution belonging to one clus- 
ter into a solution in another cluster, we have to change 
colors of 0{N) vertices, i.e., of a finite fraction of ver- 
tices. Clearly, if a network consists of only bare vertices 
(zi — 0), the space of solutions consists of a single clus- 
ter. However, above some threshold value of a mean de- 
gree, this space becomes highly clustered. The structure 
and statistics of these clusters at a given zi determine 
whether the coloring problem is computationally hard or 
not. 

The statistics of cluster s in a full range of mean 
degre es was obtained i n Krzakala et Ml dlool) and 
iZdeborova and Krzakalal (2007). Their results indicate 
a chain of topologically different phases inside the col- 
orable phase, see Fig. 1341 An important notion in this 
kind of problems is a frozen variable. (A variable here is a 
vertex.) By definition, a frozen variable (vertex) has the 
same color in all solutions of a given cluster. Figure [34] 
demonstrates that the clusters with frozen variables are 
statistically dominating in the range Cr < zi < Cp. Re- 
markably, the computational hardness was observed only 
in this region, although the replica symmetry breaking 
was found in the essentially wider range Cd < zi < Cp. 

Coloring the Watts-Strogatz small-world networks was 
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FIG. 34 Schematic phase diagram and structure of solu- 
tions for coloring the Erdos-Renyi graphs in p-colors versus 
the average degree zi. (i) zi < Cd,+ , solutions form one large 
connected cluster without frozen variables (open circle), (ii) 
Cii.+ < 21 < Cd, in addition to a large cluster, small disjoint 
clusters with frozen variables (black circles) appear. They 
include however an exponentially small fraction of solutions, 
(iii) Cd < zi < Cc, solutions are arranged in exponentially 
many clusters of different sizes with and without frozen vari- 
ables. Exponentially many clusters without frozen variables 
dominate, (iv) Cc < zi < Cr, there are a finite number 
statistically dominating large clusters. These clusters does 
not contain frozen variables, (v) Cr < zi < Cp, dominat- 
ing clusters contain frozen variables. Above Cp, a graph is 
p-uncolorable. Cd,+ coincides with the 2-core birth point. Cd, 
Cc, and Cr correspond to so-called clustering, condensation, 
and rigidity (freezing) transition s, respectively. Adapted from 
IZdeborova and Krzakalal l|2007l '). 



the larger the distance between two neighboring points 
in the space the smaller is the s trength. The ener gy of 
the model is given by Eq. (fTTO)) . iBlatt et al\ (|1996D used 
Monte Carlo simulations of the Potts model at several 
temperatures in order to reveal clusters of spins with 
strong ferromagnetic correlations between neighboring 
spins. Clusters of aligned spins showed a superparamag- 
netic behavior at low temperatures. They were identified 
as clusters in the data set. An analysis of real data, such 
as Iris data and data taken from a satellite image of the 
E arth, demonstrated a good perf ormance of the method. 

iLambiotte and Auslood ( 20051 ) studied a complex bi- 
partite network formed by musical groups and listen- 
ers. Their aim was to uncover collective listening habits. 
These authors represented individual musical signatures 
of people as Potts vectors. A scalar product of the vectors 
characterized a correlation between music tastes. This in- 
vestigation found that collective listening habits do not 
fi t the usual genres defined b y the music industry. 

iReichardt and Bornhold^ (|2004 l2006t ) proposed to 
map the communities of a network onto the magnetic 
domains forming the ground state of the p-state Potts 
model. In this approach, each vertex in the network is 
assigned a Potts state a = 1,2, ...p. Vertices, which are 
in the same Potts state a, belong to the same community 
a. The authors used the following Hamiltonian: 



studied numerically bv lWalshI ( 1999t ). He found that it is 
easy to color these networks at small and large densities 
of shortcuts, p. However it is hard to color them in the 
intermediate region of p. 



D. Extracting communities 

It is a matter of common experience that a complex 
system or a data set may consist of clusters, communities 
or groups. A common property of a network having a 
community structure is that edges are arranged denser 
within a community and sparser between communities. 
If a system is small, we can reveal a community structure 
by eye. For a la rge network we need a special method 
( Newmaiil . l2003al) . Statistical physics can provide useful 
tools for this purpose. In particular, the Potts model has 
interesting applications which are ranged from extracting 
species of flowers, collective listening habits, communities 
in a football league to a search of groups of configurations 
in a protein folding network. 

iBlatt et all (|1996[ ) showed that a search for clusters in a 
data set can be mapped to extracting superparamagnetic 
clusters in the ferromagnetic Potts model formed in the 
following way: each point in the data set is represented 
as a point in a d-dimensional space. The dimensionality d 
is determined by the number of parameters we use to de- 
scribe a data point, e.g., color, shape, size etc. A Potts 
spin is assigned to each of these points. The strength 
of short-range ferromagnetic interaction between nearest 
neighboring spins is calculated following a certain rule: 



1 A ^ 



where Uij are the elements of the adjacency matrix of 
the network, Us is the number of vertices in the com- 
munity a, i.e.. Us = '^iSai,a- The number of possible 
states, p, is chosen large enough to take into account all 
possible communities. A is a tunable parameter. The 
first sum in Eq. (|123p is the energy of the ferromagnetic 
Potts model. It favors merging vertices into one com- 
munity. The second repulsive term is minimal when the 
network is partitioned into as many communities as pos- 
sible. In this approach the communities arise as domains 
of aligned Potts spins in the ground state which can be 
found by Monte Carlo optimization. 

At A = 1 the energy Eq. (|123[) is proportional to the 
modularity measure Q, namely Ti. — —QL where L is the 
total number of edges in the network. Thus the ground 
state of the model Eq. p23p corresponds to the maxi- 
mum modul arity Q. The modu la rity measure was in- 
trodu ced in IClauset et aZI (|2004D : |N ewman and GirvanI 
(I2004D . For a given partition of a network into communi- 
ties, the modularity is the difference between the fraction 
of edges within communities and the expected fraction of 
such edges under an appropriate null model of the net- 
work (a random network model assuming the absence of 
a modular structure): 
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Here La and L'^^'^ are the numbers of edges within com- 
munity a in the network and in its null model, respec- 
tively; pij is the probability that vertices i and 7 are 
conne c ted in the null model. Reichard t and Bor nholdt 
(I2004L I2OO6D used the configuration model as the null 
model, i.e., pij — qiqj/2L where qi and qj are degrees 
of vertices i and j respectively. Tuning A and p, one 
can find a partition of a given network into communi- 
ties such that a density of edges inside communities is 
maximal when compared to one in a completely random 
network. If however the size distribution of communities 
is sufficiently broad, then it is not easy to find an optimal 
value of the parameter A. Searching for small communi- 
ti es and the resolu t ion lim it of this method are discussed 
in'Kump ula et al\ ( 20071 ). Interestingly, finding the par- 
tition of a complex network into communities, such that 
it maxim izes the modularity m easure, is an NP-complete 
problem (|Brandes~eFaI", '200^ . 

iReichard t and Bojnholdj (j2004l [200i) applied the 
Potts model Eq. (jl23p to study a community structure 
of real world networks, such as a US college football net- 
work and a large protein folding network. 

iGuimera et al\ ( 20041 ) proposed another approach to 
the problem of extracting communities based on a spe- 
cific relation between the modularity measure Q and the 
ground state energy of a Potts model with multiple in- 
teractions. 



VIII. THE XY MODEL ON NETWORKS 

The XY model describes interacting planar rotators. 
The energy of the XY model on a graph is 



hi 



(125) 



where the elements of the adjacency matrix of the 

graph, 6i is the phase of a rotator at vertex i, J is the cou- 
pling strength. Unlike the Ising and Potts models with 
discrete spins, the XY model is described by continuous 
local parameters and belongs to the class of models with 
continuous symmetry. 

A one-dimensional XY model has no phase transi- 
tion. On a two-dimensional regular lattice, this model 
(J > 0) undergoes the unusual Berezinskii-Kosterlitz- 
Thouless phase transition. On a d-di mensional lattice at 
d > 4 and the fully connected graph (l Antoni and Ruffol . 
I1995D the ferromagnetic phase transition in the XY 
model is of second order with the standard mean-field 
critical exponents. 

The study of the XY model on complex networks is 
motivated by several reasons. In principal, the continu- 
ous symmetry may lead to a new type of critical behavior 
in complex networks. Moreover the ferromagnetic XY 
model is close to the Kuramoto model which is used for 
describing the synchronization phenomenon in Sec. IX. Al 
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FIG. 35 p — T phase diagram of the ferromagnetic XY model 
on the Watts-Strogatz network, p is the fraction of shortcuts. 
D and O denote the disordered and ordered phases, respec- 
tively. The inset shows that the critical tempera ture is well 
appro ximated by a function 0.41 Inp -I- 2.89. From lKim et al\ 
(|200ll ). 



A. The XY model on small-world networks 

There were a few studies of the XY model on com- 



plex networks. iKim et al. I (1200 Ih carried out Monte- 
Carlo simulations of the ferromagnetic XY model on 
the Watts-Strogatz small-world network generated from 
a ring of N vertices. They measured the order param- 



7V-iE,exp(z0, 



By using the standard 



eter r 

finite-size scaling analysis they showed that the phase 
transition appears even at a tiny fraction of shortcuts, 
p. The transition is of second order with the standard 
mean- field critical exponent (3 — 1/2 (similar to the 
phase transition in the Ising model in Sec. IVI.Pp . The 
phase diagram of the XY model is shown in Fig. [351 
There is no phase transition at p = because the sys- 
tem is one-dimensional. Surprisingly, the dependence 
of the critical temperature Tc on p was well fitted by 
a function Tc{p)/J = 0.41 Inp + 2.89 in contrast to 
Tc{p)/J (X l/|lnp| for the Ising model. The origin of 
this differ ence is unclear. Dynamic al Monte-Carlo simu- 
lations of lMedvedveva et all (2003) confirmed the mean- 
field nature of the phase transition. These authors found 
that, at T near Tc, the characteristic time r scales as 
T ^ ^/N as it should be for networks with rapidly de- 
creasing degree distribution (see the theory of finite-size 
scaling in Sec. IIX.B)) . 



B. The XY model on uncorrelated networks 

An exact solution of the XY model on tree-like net- 
works, in principle, can obtained in the framework of the 
belief propagation algorithm, see Eq. (|69p . Another an- 
alytical approach based on the re plica theory a nd th e 
cavity method was d eveloped by Coolen et al\ (12005 ): 
ISkantzos et al. I (|2005D . see also ISkantzos and HatchettI 



47 



( 20071 ) for the dynamics of a related model. We here 
consider the influence of network topology on the critical 
behavior of the XY model, using the annealed network 
approximation from Sec. IVI.A.3I Recall that in this ap- 
proach, the element of adjacency matrix is replaced 
by the probability that two vertices i and j with degrees 
Qi and qj, are linked. In this way, for the configuration 
model, we obtain the XY model with a degree dependent 
coupling on the fully connected graph: 
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This model is solved exactly by using a weighted complex 
order parameter 
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The phase V' determines the direction along which rota- 
tors are spontaneously aligned. The order parameter r is 
a solution of an equation: 



(128) 



where Io{x) and Ii{x) are the modified Bessel functions. 
An analysis of Eq. (|128[) shows that the ferromagnetic 
XY model has the same critical behavior as the ferro- 
magnetic Ising model. Notice that the usually used order 



parameter r 



J8i 



has the same critical behav- 



ior as r. The critical temperature of the continuous phase 
transition is Tc = J{q'^)/2zi. It is finite in a complex net- 
work with a finite second moment (g^), and diverges if 
(g^) oo. In the latter case, the XY model is in the 
ordered state at any finite T. The annealed network ap- 
proximation predicts that the XY model on the Watts- 
Strogatz small-world network has the standard mean- 
field critical b ehavior. This ag rees with the numerical 
simula tions in iKim et al\ ( 200lh and iMedvedveva et all 
(I2003D . 



IX. PHENOMENOLOGY OF CRITICAL PHENOMENA IN 
NETWORKS 

Why do critical phenomena in networks differ so 
strongly from those in usual substrates and what is their 
common origin? Why do all investigated models demon- 
strate universal behavior when (g^) diverges? In order 
to answer these questions and analyze results of simula- 
tions and experiments from a general point of view, we 
need a general theory which is not restricted by specific 
properties of any model. 

In the phenomenological approach, the origin of in- 
teractions and nature of interacting objects are irrele- 
vant. In this section, we consider a phenomenological 
theory of cooperative phenomena in networks proposed 



by iGoltsev et al. I (|2003l ). This theory is based on con- 
cepts of the Landau theory of continuous phase transi- 
tions and leads to the conclusion that the universal crit- 
ical behavior in networks is determined by two factors: 
(i) the structure of a network and (ii) the symmetry of a 
given model. 



A. Generalized Landau theory 

Let us consider a system of interacting objects. Inter- 
actions or links between these objects form a net. We 
assume that some kind of order can emerge. This or- 
dered phase may be characterized by some quantitative 
characteristic x while it will vanish in a disordered phase 
above a critical point. We assume that the thermody- 
namic potential <& of the system is not only a function 
of the order parameter x but also depends on the degree 
distribution: 



<i>{x, H) = -Hx + ^ P{q)(f>{x, qx) . 



(129) 



Here iJ is a field conjugated with x. Equation (|129p is 
not obvious a priori. The function (j){x^ qx) can be con- 
sidered as a contribution of vertices with q connections. 
There are arguments in favor of this assumption. Let 
us consider the interaction of an arbitrary vertex with q 
neighboring vertices. In the framework of a mean-field 
approach, q neighbors with a spontaneous "moment" x 
produce an effective field qx acting on this vertex. 
We impose only general restrictions on (j){x,y): 

(i) 4>{x, y) is a smooth function of x and y and can be 
represented as a series in powers of both x and y. 
Coefficients of this series are functions of "temper- 
ature" T and "field" H. 

(ii) ^{x,H) is finite for any finite average degree (q). 

A network topology affects analytical properties of $. 
If the distribution function P{q) has a divergent moment 
(qP) , then we have 



^x,H) = -Hx + Y,fnx" 



■ x^s(x) , 



(130) 



n=2 



where s{x) is a non-analytic function. The specific form 
of s{x) is determined by the asymptotic behavior of P{q) 
at g 3> 1. It is the nonanalytic term that can lead to a 
deviation from the standard mean-field behavior. 

Following Landau, we assume that near the critical 
temperature the coefficient /2 can be written as a(T — 
Tc) where a is chosen to be positive for the stability of 
the disordered phase. The stability of the ordered phase 
demands that either /a > or if /a = 0, then /4 > 0. 
The order parameter x is determined by the condition 
that ^{x,H) is minimum: d^{x,H)/dx = 0. 
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If degree distribution exponent 7 is non-integer, then 
the leading nonanalytic term in is x'^~^. If 7 is 

integer, then the leading nonanalytic term is x'^~^ |lna;|. 
Interestingly, this nonanaliticity looks like that of the free 
energy for the ferromagnetic Ising model in magnetic field 
on a Cayley tree (see Sec. IVLBj) . 

We must be take into account a symmetry of the sys- 
tem. When ^{x,H) = x, — 7?) and the coefhcient 
fi is positive, we arrive at the critical behavior which 
describes the ferromagnetic Ising model on equilibrium 
uncorrelated random networks in Sec. IVI.C.2I In a net- 
work with (<7*) < 00 a singular term in $ is irrelevant, 
and we have the usual x^- Landau theory which leads to 
the standard mean-field phase transition. The singular 
term x"'~^ becomes relevant for 2 < 7 < 5 (this term 
is a;^ I In a; I at 7 = 5). Critical exponents are given in 
Table HI At the critical point T = Tc the order parame- 
ter a; is a non-analytic function oi H: x oc H^^^ , where 
<5(7 > 5) = 3 and (5(3 < 7 < 5) = 7 - 2. 

If the symmetry of the system permits odd powers 
of a; in $ and /a is positive, then the phenomenologi- 
cal approach gives a critical behavior which was found 
for percolation on uncorrelated random networks in Sec. 
nil. B. 21 Note that when 7 > 4, a singular term x^~^ is 
irrelevant. It becomes relevant for 2 < 7 < 4 (this term 
is x^ \\nx\ at 7 = 4). 

At 2 < 7 ^ 3, the thermodynamic potential has a 
universal form, independent on the symmetry: 



^{x,H) = -Hx + Cx'^ - Ds{x), (131) 



|lnx| for 7 = 3, and s(x) = x"' ^ for 



where s{x) = 

2 < 7 < 3. We can choose C oc and D (x T, then 
the phenomenological theory gives a correct temperature 
behavior of the ferromagnetic Ising model. 

When /s < (or /4 < if /a = 0), the phenomeno- 
logical theory predicts a first-order phase transition for a 
finite {q^}- This corresponds, e.g., to the ferromagnetic 
Potts model with p> 3 states (see Sec. I VIII) . 

The phenomenological approach agrees with the mi- 
croscopic theory and numerical simulations of the fer- 
romagnetic Ising, Potts, XY, spin glass, Kuramoto 
and the random-field Ising models, percolation and epi- 
demic spreading on various uncorrelated random net- 
works. These models have also been studied on complex 
networks with different clustering coefhcients, degree cor- 
relations, etc. It seems that these characteristics are not 
relevant, or at least not essentially relevant, to critical be- 
havior. When the tree ansatz for complex networks gives 
exact results, the phenomenology leads to the same con- 
clusions. In these situations the critical fluctuations are 
Gaussian. We strongly suggest that the critical fluctua- 
tions are Gaussian in all networks with the small-world 
effect, as is natural for infinite-dimensional objects. 



B. Finite-size scaling 

Based on the phenomenological theory one can get 
scaling exponents for finite-size scaling phenomena in 
complex networks. Let "I>(m, r, H, N) be a thermody- 
namic potential per vertex, where r is the deviation from 
a critical point. According to the standard scaling hy- 
pothesis (in its finite-size scaling form), in the critical 
region. 



N^{m, T, H, N) ^ UimN'^, rNy, HN''), 



(132) 



where f^{a^h,c) is a scaling function. Note that there 
is exactly N on the left-hand side of this relation and 
not an arbitrary power of N . Formally substituting 
^{m,T, H) — Atw? -t- Bm'-^^^^ — Hrn, one can find ex- 
ponents X, y, and z. As was explained, A may be 

(i) min(4,7 — 1), as, e.g., in the Ising model, or (ii) 
min(3,7 — 1), as, e.g., in percolation. This naive sub- 
stitution, however, does not allow one to obtain a proper 
scaling function, which must be analytical, as is natural. 
The derivation of the scaling function demands more rig- 
orous calculations. 

As a result, for the two classes of theories listed above, 
we arrive at the following scaling forms of the order pa- 
rameter: 

(i) for 7 > 5, m{T,H,N)=N-^/^f{N^/^T,N^^^H),{133) 

(ii) for 7 > 4, m{T,H,N)=N-^/^f{N^/^T,N^/^H),{13'i) 

and for more small 3<7<5(i)or3<7<4 (ii), m 
scales as 

m(r,i7,iV)=7V-i/(^-i)/(iV(^-3)/(7-i)^^^(7-2)/(7-i)^). 

(135) 

iHong et all (|2007al ) obtained these scaling relations 
(without field) by using other arguments and confirmed 
them simulating the Ising model on the static and the 
configuration models of uncorrelated networks. Their 
idea may be formally reduced to the following steps. Re- 
call a relevant standard scaling relation from the physics 
of critical phenomena in lattices. The standard form is 
usually written for dimension d lower than the upper crit- 
ical dimension So, rewrite this scaling relation for 
d > du'. substitute du for d and use the mean-field values 
of the critical exponents which should be obtained as fol- 
lows. For networks, in this relation, formally substitute 
v — \/2 for the correlation length exponent and = 
for the Fisher exponent, use the susceptibility exponent 
7 = t/(2 - 77) = 1, exponent (3 = I3{^) (see Sec. lIX.Ap . 
and 



2A(7) 
A(7) - ^ 



(136) 



( Hong et"aLl . l2007"ah . This procedure allows one to eas- 
ily derive various scaling relations. We have used it in 
Sec. lIILB.3l 

Finite-size scaling of this kind wo rks in a wide class o f 
models and processes on networks. iHong et al\ (|2007a[ ) 
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also applied th ese ideas t o the conta ct process on net- 
works . EarUer. lKim et all ( 200l[ ) and iMedvedveva et all 
studied the finite size scaling by simulating the 
XY model on the Watts-Strogatz network. In their work, 
in particular, they investigated the dynamic finite-size 
scaling. In the framework of our phenomenology, we 
can easily reproduce their results and generalize them to 
scale-free networks. Let us assume the relaxational dy- 
namics of the order parameter: dm/dt = —d^{m)/dm. 
In dynamical models, the scaling hypothesis also implies 
the scaling time variable, igcai = tN~'^ , which means that 
the relaxation time diverges as N" at the critical point. 
For brevity, we only find the form of this scaling variable, 
which actually resolves the problem. In terms of scaling 
variables, the dynamic equation for the order parameter 
must not contain N . With this condition, passing to the 
scaling variables mN^ and tN^^ in the dynamic equa- 
tion, we immediately get s — y, which means that time 
scales with N exactly in the same way as 1/t. So, for 
the indicated two classes of theories, (i) and (ii), the time 
scaling variable is of the following form: 



in theory (i), for 7 > 5, <,cai - tN'^/^, 
in theory (u), for 7 > 4, i^cai = ^iV~^/^ 



(137) 



and 



in theory (i), for 3<7<5, and in theory (ii), for 3<7<4, 

tscal = i7V-(T-3)/(T-l). (138) 

Finally, w e recommend that the reader refer to 
iGallos etal\ |2007b) for the finite-size scaling in scale- 
free networks with f ractal properties. For descripti on of 
thes e networks , see ISong et al\ (|2005l l2006l 120071) and 
also lGoh et ail )\200&) . 




FIG. 36 Schematic view of phases in the Kuramoto model. 

(a) Incoherent phase. Unit length vectors representing in- 
dividual states are randomly directed in the complex plane. 

(b) Coherent phase. The individual states condense around a 
direction tp- 



observed i n synchronization dyna mics of pulse-coupled 
oscillators ( Guardiola et al I I2OOOD . where homogeneous 
systems synchronize better. 

We here consider the effect of the network topology on 
the synchronization in the Kuramoto model and a net- 
work of coupled dynamical systems. These two models 
represent two different types of synchronization phenom- 
ena. The interested reader will find the discussion of 
this effect for co upled m ap lattices in Atay et al. (2004J 
Gade and Hul (I2OOOD: iGrinstein and Linskd (I200E 



Hua ng et al 



Jost and Jovl (200lh : iLind et all 



(: 20 £]. for networks o f Hodgkin-Huxley neurons — i n 



iKwon and MoonI (|2002l) : iLago-Fernandez et all tOOO), 



for pulse-cou p led o scillators — in iDenker et all (|2004 ): 



iTimme a/.l (12004), and for the Edwards- Wilkinson 



model — in Kozma et M (120041 ). 



A. The Kuramoto model 



X. SYNCHRONIZATION ON NETWORKS 

Emergence of synchronization in a system of coupled 
individual oscillators is an intriguing phenomenon. Na- 
ture gives many well-known examples: synchronously 
flashing flreflies, crickets that chirp in unison, two 
pendulum clocks mounted on the same wall synchro- 
nize their oscillations, synchronous neural activity, and 
many others. Different dynamical models were proposed 
to describe collective synchroni zation, see, fo r exam- 
ple, m onographs and reviews of iPikovskv et al. 



2003) . 



IStrop tz (2003), Strogatj j2000l ). lAcebron et al 
and Bocc aletti et all (|200tf). 

Extensive investigations aimed at searching for 
network architectures which optimize synchroniza- 
tion. First (mostly numerical) studies of vari- 
ous dynamical models have already revealed that 
the ability to synchr onize can be impro ved in 



small-world network s (iBarahona and Pecoral 
Gade and Hu, 2000; Hong et all. l2002al: iJosTand Jov 



2002; 



2001 1 : ILago-Fernandez et all . I2OOOI: IWang and Chen 
20021 ). On the other hand, an opposite effect was 



The Kuramoto model is a classical paradigm for 
a spontaneous emergence of coflective synchron ization 
(|Acebr6n et all . 120051 : iKuramotol 1 1984 IStrogatd . |2000) . 
It describes collective dynamics of N coupled phase oscil- 
lators with phases 0i{t), i = 1,2, ...TV, running at natural 
frequencies tof. 



N 

J aij sin( 



(139) 



2001), where Uij is the adjacency matrix of a network. J is 
the coupling strength. The frequencies LOi are distributed 
according to a distribution function g{uj). It is usually 
assumed that g{Lu) is unimodular and symmetric about 
its mean frequency fl. It is convenient to use a rotating 
frame and redefine 9i —f 9i — ilt for all i. In this frame 
we can set the mean of g{u}) to be zero. The state of 
oscillator j can be characterized by a complex exponent 
exp{i9j) which is represented by a vector of unit length 
in the complex plane (see Fig. IM)). 

The Kuramoto model is solved exactly for the fully 

= 1 for 



connected graph (all-to-all interaction), i.e. 
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all i ^ with rescaling J ^ J/N. When J < Jc, there 
is no collective synchronization between the rotations of 
individual oscillators. Nonetheless some finite clusters of 
synchronized oscillators may exist. Collective synchro- 
nization between oscillators emerges spontaneously above 
a critical coupling Jc ii N ^ oo. The global state of the 
model is characterized by the following average: 



r(t)e 



N ^ 



(140) 



where r{t) is the order parameter which measures the 
phase coherence, and ipit) is the average phase. Simula- 
tions show that if we start from any initial state, then at 
J < Jc in the incoherent phase, r(t) decays to a tiny jit- 
ter of the order of 0{N~^^^). On the other hand, in the 
coherent phase (J > Jc), the parameter r{t) decays to a 
finite value r{t oo) = r < 1. At J near Jc, the order 
parameter r oc \J ~ Jcf with f3 = 1/2. In the original 
frame, tpit) rotates uniformly at the mean frequency O. 
Substituting Eq. (fHO)) into Eq. ([1^ gives 



et= ijji + Jr sin('(/' - 9i). 



(141) 



The steady solution of this equation shows that at J > 
Jc, a finite fraction of synchronized oscillators emerges. 
These oscillators rotate coherently at frequency in the 
original frame. In the rotating frame, they have indi- 
vidual frequencies < Jr and their phases are locked 
according to the equation: sin6'i = uii/ Jr, where we set 
-0 = 0. Others oscillators, having individual frequencies 
\uji\ > Jr, are "drifting". Their phases are changed non- 
uniformly in time. The order parameter r satisfies the 
self-consistent equation: 



Jr 



J2^2 



g{u})duj. 



(142) 



which gives the critical coupling Jc = 2/ [775(0)]. Note 
that the order of the synchronization phase transition in 
the Kuramoto model depends on the distribution g{uj). 
In particular, it can be of first or der if the natural fre - 
quencies are uniformly distributed ( Tanaka et a/.l . [l997[ ) . 

The Kuramoto model on finite networks and lat- 
tices shows synchronization if the coupling is sufficiently 
strong. Is it possible to observe collective synchroniza- 
tion in the Kuramoto model on an infinite regular lat- 
tice? For sure, there is no synchronization in a one- 
dimensional s ystem wit h a sho r t-rang ed coupling. Ac- 
cording to Hong et all (|2004bl . l2005f) . phase and fre- 
quency ordering is absent also in two-dimensional {d ~ 2) 
lattices; frequency ordering is possible only in three-, 
four-, and higher-dimensional lattices, while phase or- 
dering is possible only when d > A. The value of the 
upper critical di mension of the Kuram oto model is still 
under discu s sion ([Acebron et all |2005| ) . Simulations in 
iHong et al\ ( 2007b ) indicate the mean- field behavior of 
the Kuramoto model at d > 4. 



B. Mean-field approach 

The Kuramoto model was recently investigated numer- 
ically and analytically on complex networks of different 
architectures. We here first look at analytical studies 
and then discuss simul ations though the m odel was first 
studied numerically in lHong et all ( 2002al) . 



Unfortunately no exact results for the Kuramoto model 
on complex networks are obtained yet. A finite mean de- 
gree and a strong heterogeneity of a complex network 
make difficult to find an ana lytic al solution of the model. 
Ilchinomival (l2004l . I2005D and lLed (|2005t) developed a sim- 
ple mean-field theory which is actually equivalent to the 
annealed network approximation in Sec. IVI.A.3I Using 
this approximation, we arrive at the Kuramoto model 
with a degree dependent coupling on the fully connected 
graph: 



Jqi 



N 



9i=a;» + ^^gjsin(6ij-6ii). (143) 

This effective model can be easily solved exactly. Intro- 
ducing a weighted order parameter 



?{t)e 



1 



N 



one can write Eq. (|143p as follows: 

01^ uji + Jrqi sin(V' - Oi)- 



(144) 



(145) 



The steady solution of this equation shows that in the 
coherent state, oscillators with individual frequencies 
^ Jrqi are synchronized. Their phases are locked 
and depend on vertex degree: sm0i — uji/(Jrqi), where 
we set "0 = 0. This result shows that hubs with degree 
qi ^ 1 synchronize more easy than oscillators with low 
degrees. The larger the degree qi the larger the proba- 
bility that an individual frequency oji of an oscillator i 
falls into the range [—Jrqi, Jrqi]. Other oscillators are 
drifting, r is a solution of the equation: 



E 



P{q)q 



zi 




{J7qf 



g{uj)dLo. (146) 



Spontaneous synchronization with r > emerges above 
the critical coupling 



Jc 



2zi 



(147) 



which strongly depends on the degree distribution. Jc is 
finite if the second moment (g^) is finite. Note that at a 
fixed mean degree zi, Jc decreases (i.e., the network syn- 
chronizes easily) with increasing ^g^) — increasing hetero- 
geneity. Similarly to percolation, if the moment ^g^^ di- 
verges (i.e., 2 < 7 < 3), the synchronization threshold 
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Jc is absent, and the synchronization is robust against 
random failures. In finite networks, the critical coupling 
is finite, JdN) oc l/ql~^(N), and is determined by the 
size-dependent cutoff qcut{N) in Sec. III.ET41 

Another important result, which follows from 
Eq. ()146|) . is that the network topology strongly i nfiu- 
ences the critical behavior of the order parameter r. iLed 
(I2005D found that the critical singularity of this parame- 
ter is described by the standard mean-field critical ex- 
ponent (3 = 1/2 if an uncorrelated network has a fi- 
nite fourth moment (g"*), i.e., 7 > 5. If 3 < 7 < 5, 
then (3 = 1/(7 — 8). Note that the order parameters 
r, Eq. (fT40)) . and f, Eq. pl4)) . have the same critical 
behavior. Thus, with fixed zi, the higher heterogene- 
ity of a network, the better its sinchronizability and the 
smoother the phase transition. The critical behavior of 
the Kuramoto model is similar to one found for the fer- 
romagnetic Ising model in Sec. IVI.CI and confirms the 
phenomenological theory described in Sec. IIXI A finite- 
size scaling analysis of the Kuramoto model in complex 
networks was carried out bv lHong et al\ ( 2007c| ). Within 
the mean-field theory, they found that the order param- 
eter r has the finite-size scaling behavior. 



(148) 



with the critical exponent /3 found above. Remarkably, 
the critical exponent V is different from that of the Ising 
model in Sec. IIX.BI namely, V — 5/2 at 7 > 5, F = 
(27 - 5)/(7 - 3) at 4 < 7 < 5, 17 = (7 - l)/(7 - 3) at 
3 < 7 < 4. Simula ti ons of the Kuramoto model carried 
out by iHong et~al\ ( 2007cl ) agree with these analytical 
results. 

The mean-field theory of synchronization is based on 
the assumption that every oscillator "feels" a "mean 
field" created by nearest neighbors. This assumption is 
valid if the average degree zi is suf ficiently large. I n order 
to improve the mean-field theory, iRestrepo et al. I (|2005D 
introduced a local order parameter at vertex n, 



rne 



J0„ 



(149) 



and found it by using intuitive arguments. In their ap- 
proach the critical coupling Jc is inversely proportional 
to the maximum eigenvalue Amax of the adjacency ma- 
trix Uij. However, in an uncorrelated random com- 
plex network, the maximum eigenvalue Amax is deter- 
mined by the cutoff qcut{N) of the degree distribution, 
Amax ~ ol-i^iN) dC hung et al!, '200^ JPorogovtsev et all 
I2OO3I: iKrivelevich and Sudakov , 2003|). In scale- free net- 
works (7 < 00), the cutoff diverges in the limit N 00. 
Therefore this approach predicts Jc = in the thermo- 
dynamic limit even for a scale-fre e network with 7 > 3 in 
sharp cont rast to the approach of llchinomival ( 2004f ) and 
lLe3 (l2005^ 

Oh et al. (I2OO7D udied the Kuramoto model with 



asymmetric degree dependent coupling Jq^ ^aij instead 
of Jaij in Eq. (|139p by using the mean-field theory. They 



found that tuning the exponent 77 changes the critical 
behavior of collective synchronization. On scale-free net- 
works, this model has a rich phase diagram in the plane 
(77,7). In the case 77 = 1, the critical coupling Jc is finite 
even in a scale-free network with 2 < 7 < 3 contrary to 
Jc = for the symmetric coupling which corresponds to 
77 = 0. Note that the influence of the degree dependent 
coupling is similar to the effect of degree dependent in- 
teractions on the phase transition in the ferromagnetic 
Ising model (see Sec. IVI.C3]) . 



C. Numerical study of the Kuramoto model 

The Kuramoto model was in v estigat ed numerically on 
various networks. iHong et~al\ (|2002aD studied numeri- 
cally the model on the Watts-Strogatz network generated 
from a one-dimensional regular lattice. They observed 
that collective synchronization emerges even for a tiny 
fraction of shortcuts, p, which make the one-dimensional 
lattice to be a small world. The critical coupling Jc is 
well approximated as follows: Jc{p) ~ 2/[7rg(0)] -I- ap^^, 
where a is a constant. As one might expect, the syn- 
chronization phase transition is of second order with the 
standard critical exponent /? = 0.5. 

The evolution of synchronization in the Kuramoto 
model on the Erdos-Rcnyi and scale-free networks was 
recently studied by Gomez -Gardenes et al. (2007a, b). 
These authors solved numerically Eq. (|139p for N = 1000 
coupled phase oscillators and demonstrated that (i) the 
synchronization on a scale-free network (7 = 3) appears 
at a smaller critical coupling Jc than the one on the 
Erdos-Renyi network (with the same average degree as 
the scale- free network), (ii) the synchronization phase 
transition on the Erdos-Renyi network is sharper than 
the transition on the scale-free network. This critical 
beh avior agrees qualitatively with the mean-field the- 
ory. iGomez -Gardef ies et al\ ('2007a'b") calculated a frac- 
tion of synchronized pairs of neighboring oscillators for 
several values of the coupling J and revealed an inter- 
esting difference in the synchronization patterns between 
the Erdos-Renyi and scale- free networks (see Fig. [57]) . In 
a scale-free network, a central core of synchronized oscil- 
lators formed by hubs grows with J by absorbing small 
synchronized clusters. In contrast, in the Erdos-Renyi 
network numerous small synchronized clusters homoge- 
neously spread over the graph. As J approaches Jc, they 
progressively merge together and form larger clusters. 

[m oreno and Pachecol (|2004l ) carried out numerical 
study of the Kuramoto model on the Barabasi- Albert 
network of size iV = 5 x 10^. They found that the critical 
coupling is finite, though small. Surprisingly, the mea- 
sured critical exponent was close to the standard mean- 
field value, (3 ~ 0.5, contrary to an infinite order phase 
transition and zero Jc predicted by the mean-field the- 
ory in the limit N ~* 00. A reason of this discrepancy is 
unclear. 

A community (modular) structure of complex networks 
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FIG. 37 Synchronization patterns of Erdos-Renyi (ER) and 
scale- free (SF) networks for several values of coupling A (or J 
in our notations). From lGdmez-Gardenes et aLl (|2007al l. 



makes a strong effect on synchronization. In such net- 
works, oscillators inside a community are synchronized 
first because edges within a community are arranged 
denser than edges between communities. On the other 
hand, intercommunity edges stimulate the global syn- 
chronization. The role of network motifs for the syn- 
chronization in the Kuramot o mod el was first s tudied 
numerically by iMoreno et al\ (|2004[ ). lOh et all (|2005l ) 
solved numerically the dynamical equations Eq. (|139|) 
with the asymmetric degree dependent coupling Jq^^Uij 
for two real networks — the yeast protein interaction net- 
work and the Internet at the Autonomous system level. 
These networks have different community structures. In 
the yeast protein network, communities are connected di- 
versely while in the Internet communities are connected 
mainly to the North America continent. It turned out 
that for a given coupling J, the global synchronization 
for the yeast network is stronger than that for the Inter- 
net. These numerical calculations showed that the dis- 
tributions of phases of oscillators inside communities in 
the yeast network overlap each other. This corresponds 
to the mutual synchronization of the communities. In 
contrast, in the Internet, the phase distributions inside 
communities do not overlap, the communities are cou- 
pled weaker and synchronize independently. A modular 
structure produces a si milar effect on synch ronization of 
c oupled-map ne t works ( Huang et all |2006| ) . 

[Arenas et Ml (|2006aM showed that the evolution of 
a synchronization pattern reveals different topological 
scales at different time scales in a complex network with 
nested communities. Starting from random initial con- 
ditions, highly interconnected clusters of oscillators syn- 
chronize first. Then larger and larger communities do the 
same up to the global coherence. Clustering produces 



same up to tne global conerence. L-lustermg p roduces 
a similar effect. iMcGraw and Menzingerl (200a) studied 
numerically the synchronization on the Barabasi- Albert 
networks of size TV — 1000 with low and high clustering 
coefficients (networks with a high clustering coeffi cient 
were g enerated by using the method proposed by iKimI 
(12004 )). These authors found that in a clustered net- 



work the synchronization emerges at a lower coupling J 
than a network with the same degree distribution but 
with a lower clustering coefficient. However, in the latter 



n etwork t h e glob al synchronization is stronger. 

iTimmd (l2006i) simulated the Kuramoto model on di- 
rected networks and observed a topologically induced 
transition from synchrony to disordered dynamics. This 
transition may be a general phenomenon for different 
types of dynamical models of synchronization on directed 
networks. 

Synchronization of coupled oscillators in the Ku- 
ramoto model to an external periodic input, called 
pacemaker, was studi ed for lattices, Cayl ey tre t 
complex networks by Kori and Mikhail ovl (12004 
iRadicchi and Mever-Ortmannd (|2006l ); lYamadal 
This phenomenon is called entrainment. The pacemaker 
is assumed to be coupled with a finite number of vertices 
in a given network. Entrain ment appears above acrit- 
ical coupling strength Jcr- iKori and Mikhailovl ( 2004 
showed that Jcr increases exponentially with increasing 
the mean shortest path distance C from the pacemaker 
to all vertices in the network, i.e., Jcr ~ e""^- In a com- 
plex network, £ is proportional to the mean intervertex 
distance i{N) which, in turn, is typically proportional to 
In TV, see Sec. III.Al This leads to ~ N^, where 5 is a 
positive exponent. It was shown that frequency locking 
to the pacemaker strongly depends on its frequency and 
the network architecture. 



D. Coupled dynamical systems 

Consider N identical dynamical systems. An individ- 
ual system is described by a vector dynamical variable 
Xi(t), i = 1,...N. The individual dynamics is governed 
by the equation: — F(xi), where F is a vector func- 
tion. These dynamical systems are coupled by edges and 
their dynamics is described by the equation: 



F(x, 



H(x,), 



(150) 



where J is the coupling strength, H(xj) is an output 
function which determines the effect of vertex j on dy- 
namics of vertex i. The network topology is encoded in 
the Laplacian matrix Lij = qiSij — Uij, where a^j is the 
adjacency matrix, and qi is degree of vertex i. The Lapla- 
cian matrix is a zero- row-sum matrix, i.e., '^jLij = 
for all i. This property has the following consequence. 
Any solution of the equation s = F(s) is also a solution 
of Eq. (|150p . x,; = s{t), i.e., dynamical systems evolve 
coherently. 

1. Stability criterion. 

We use the spectral properties of L in order to deter- 
mine the stability of the fully synchronized state against 
small perturbations, x^ = s(t) + rji. The Laplacian has 
nonnegative eigenvalues which can be ordered as follows, 
= Ai<A2^...^AAr. The zero eigenvalue corre- 



sponds to the uniform eigenfunction, 



(0) 



1 for all i 



(the synchronized state). The remaining eigenfunctions 
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/j*-^-* with A > A2 are transverse to f^'^K Represent- 
ing a perturbation as a sum of the transversal modes, 
rji = J2x>\2 Vxfi^\ we find the master stabiUty equation 
from Eqr fTSOl) : 



160 



fix = [DF{s) ~ aDB.{s)]rix, 



(151) 



where a = JX. DF and DH are the Jacobian matrices. 
If the largest Lyapunov exponent A(a) of this equation 
i s negative, then the fully synchronized state is stable 
( Pecora and C arroll. '1998"). A(a) is called the master 
stability function. This function is known for various os- 
cillators such as Rossler, Lorenz, or double-scroll chaotic 
oscillators. Equation (|15ip is valid if the coupling matrix 
Lij is diagonalizable. A generalization of the master sta- 
bility equation for non-diagonalizable networks (e.i., for 
the case of a non-symmetric c oupling matrix) is given in 
iNishikawa and Motteil (|2006allbh . 

Thus we have the following criterion of the stability: 
the synchronized state is stable if and only if A(JAn) < 
for all n = 2, ...N. In this case, a small perturbation rjx 
converges to zero exponentially ast—^oo. The condition 
A(JAi) — A(0) < determines the dynamical stability 
of the solution s(<) to the individual dynamics. 

Usually, the function A (a) is negative in a bound re- 
gion ai < a < a2- Therefore, a network is synchroniz- 
able if simultaneously JA2 > ai and JXn < ct2- This is 
equivalent to the following condition: 



Xn ^ 012 
X2 ai 



(152) 



( Barahona and Pecoral [2b02h . Note that A2 and Xn are 
completely determined by the network topology, while ai 
and a2 depend on the specific dynamical functions F and 
H. The value of a2/ct typically ranges from 5 to 100 for 
various chaotic oscillators. The criterion Eq. (|152p im- 
plies the existence of the interval (ai/A2, a2/AAr) of the 
coupling strength J where the synchronization is stable. 
The smaller the eigenratio Xn IX2, the larger this inter- 
val and the better synchronizability. If J < ai/A2, then 
modes with the small eigenvalues X < ai/J break down 
synchronization. If J > 012/ Aat, then modes with the 
large eigenvalues A > 0:2 /J lead away from the synchro- 
nized state. 

The spectrum of the Laplacian on the fully connected 
graph is simple: Ai = and A2 = ... = Xn = N . The 
eigenratio AAr/A2 is equal to 1. It corresponds to the 
highest possible synchronizabilty. In the d-dimensional 
cubic lattice of side length I = N^^'^, the minimum eigen- 
value A2 of the Laplacian is small: A2 oc . On the 
other hand, the largest eigenvalue Aat is finite: Xn ^ d. 
Therefore, the eigenratio Xn/X2 diverges as — > cxd. It 
means that the complete synchroni zation is impossible 
in an infinite d- d imens ional lattice ( Hong et all l2004al : 
IWang and Chenl . I2002D . Only a finite lattice can be 
synchronized. 




FIG. 38 Ratio Xn/X^ versus the fraction of shortcuts, p, for 
the Watts-Strosatz netw ork generated from a ring. Adapted 
from lHong ei al\ (|2004al 'l. 



2. Numerical study. 

Synchronization of coupled dynamical systems on var- 
ious complex networks was extensively studied numeri- 
cally. It turned out that the random addition of a small 
fraction of shortcuts, p, to a regular cubic lattice leads to 
a synchron i zable network (iBarahona and Pecoral 120021 : 
iHong et all l2004al : I Wang and Chenl . l2002[ ). For exam- 
ple, a ring of A'^ vertices with shortcuts is always syn- 
chronizable if A'' is sufficiently large. The shortcuts de- 
crease sharply the ratio Xn /X2 (see Fig. [38]) until the net- 
work becomes synchronizable. The heuristic reason for 
this effect lies in the fact that adding shortcuts leads to 
the Watts-Strogatz network with the small- world effect. 
The average shortest path between two vertices chosen 
at random becomes very small compared to the original 
regular lattice. In other words, the small world effect im- 
proves synchronizability of the Watts-Strogatz network 
compared with a regular lattice. 

Synchronization is also enhanced in other complex 
networks. One can show that the minimum eigenra- 
tio Xn/X2 is achieved for the Erdos-Renyi graph. In 
scale- free networks, the eigenratio Xn/X2 increases with 
decreasing degree distribution exponent 7, and so syn- 
chronizability becomes worse. T his effect was explain ed 
by the increase o f hete rogeneity I Motter et all [20"05al lbl: 
;Nishikawa_eLaI!, [2003). It was found that a suppres- 
sion of synchronization is related to the increase of the 
load on vertices. Importa ntly, the eigenrati o A Af/A 2 in 



crea ses strongly w ith A^. iKim and Motterl ( 20071 ). see 
also iMotteil (|2007D . found that the largest eigenvalue Xn 
in a uncorrelated scale-free network is determined by the 
cutoff of the degree distribution: Xn = 9cut + 1- The 
eigenvalue A2 is nearly size-independent and is ensemble 
averageable. (The last statement means that as A^ ^ 00, 
the ensemble distribution of A2 converges to a peaked 
distribution.) This leads to 



A 



N 



un[iVi/(7-i)^7Vi/2], 



(153) 
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see Sec. III. E. 41 Therefore, it is difficult or even impossi- 
ble to synchronize a large scale-free network with suffi- 
ciently small 7. These analytical results agree with nu- 
merical calculations of the Laplacian spectra of uncorre- 
lated scale-free networks. 

Another way to enhance synchronization is to use 
a network with as ymmetric or weighted couplings. 
iMotter et al. I (|2005al fbll3) considered an asymmetric de- 



gree dependent coupling matrix q~^Lij instead of Lij in 
Eq. (|150p . where ry is a tunable parameter. Their nu- 
merical and analytical calculations demonstrated that if 
rj — I, then in a given network topology the synchroniz- 
ability is maximum and does not depend on the network 
size. In this case, the eigenratio is quite insen- 

sitive to the form of the degree distribution. Interest- 
ingly, in a random network the eigenvalues A2 and Xn 
of the normalized Laplacian matrix q~^Lij achieve 1 as 



A2 = l-0(l/v/(g)) and Ajv = 1 + 0(1/ yM) in the limit 
of a large mean degree (q) 1 (|Chung| . ri997 ). Therefore 
in this limit the eigenratio Xn/X2 is close to 1, and the 
system is close to the highest possible synchronizability. 

Note that apart the synchronization, network spec- 
tra have numerous applications to structural proper- 
ties of networks and processes in them. For results on 
Laplacian spec tra of complex networks and their applica - 



tions, see, e.g., Chung ( 1997 ): Dorogovtsev et all (|2003l ): 



iKim and Motteij (|2007l ): iMotteij (|2007t ) andreferences 
therein. 

[Ch avez et al. I (|2005D found that a further enhancement 
of synchronization in scale-free networks can be achieved 
by scaling the coupling strength to the load of each edge. 
Recall that the load kj of an edge ij is the number of 
shortest paths which go through this edge. The authors 
replaced the Laplacian Lij to a zero row-sum matrix with 
off-diagonal elements —Ifj/J^jeNi ^ij' where a is a tun- 
able parameter. This weighting pr ocedure used a globa l 
information of network pathways. IChavez et al\ ( 2005h 
demonstrated that varying the parameter a, one may 
efhciently get better synchronization. A similar improve- 
ment was obtained by using a different, local weighting 
procedur e based o n the d egrees of the nearest neigh- 
bors (M otter et al\ . l2005c[ ). In networks with inhomo- 
geneous couplings between oscillators, the intensity of a 
vertex is defined a s the total strength of input couplings. 
IZhou et'oll ( 20061 ) showed that the synchronizability in 
weighted random networks is enhanced as vertex inten- 
sities become more homogeneous. 

The effect of degree correlations in a network on syn- 
chronizat ion of coupled d ynamical systems was revealed 
by , Bernardo et all ( 200?! ). These authors studied assor- 
tatively mixed scale-free networks. Their degree corre- 
lated networks were generated by using the method pro- 
posed by Newmaii (^2003d). They showed that disas- 
sortative mixing (connections between high-degree and 
low-degree vertices are more probable) enhances synchro- 
nization in both weighted and unweighted scale-free net- 
works compared to uncorrelated networks. However the 
synchronization in a correlated network depends on the 




T 



FIG. 39 Examples of graphs with optimal synchronizability: 
(a) a fully connected graph; (b) a directed star: (c) a hierar- 
chical directed random graph. 



weighting procedure ( Chavez et a/.l . [2OO6I ) . 

Above we showed that the fully connected graph gives 
the optimal synchronization. However this graph is cost- 
is-no-object and uncommon in nature. Which other ar- 
chitectures maximize the synchronizability of coupled dy- 
namical systems? iNis hikawa an d Motter (2006a, b) came 
to the conclusion that the most optimal networks are di- 
rected and non-diagonalizable. Among the optimal net- 
works they found a subclass of hierarchical networks with 
the following properties: (i) these networks embed an ori- 
ented spanning tree (i.e., there is a node from which all 
other vertices of the network can be reached by follow- 
ing directed links); (ii) there are no directed loops, and 
(iii) the total sum of input couplings at each vertex is 
the same for all vertices. Examples of optimal network 
topologies are shown in Fig. 



XI. SELF-ORGANIZED CRITICALITY PROBLEMS ON 
NETWORKS 

In this section we discuss avalanche processes in models 
defined on complex networks and other related phenom- 



A. Sandpiles and avalanches 

The sandpile dynamic s on the E rdos-Rcnyi random 
graphs was studied since (jBonabeaul [1995 1 but no essen- 
tial differe n ce fro m high-dime n sional lattices was found. 
iGoh et al\ ([loO^); [ Lee et Ml (|2004allbl 'l investigated a 
variation of the famous Bak-Tang-Wiesenfeld (BTW) 
model on scale-free uncorrelated networks and observed 
an effect of the network architecture on the self-organized 
criticality (SOC) phenomenon. Let us discuss these re- 
sults. 

The model is defined as follows. For each vertex i, a 
threshold — 9,^ is defined, where < 77 < 1, so that 
o-i < Qi- A number of grains at vertex i is denoted by hi. 



(i) A grain is added to a randomly chosen vertex i, and 
hi increases by 1. 

(ii) If the resulting hi < Ui, go to (i). On the other 
hand, if hi > ai, then hi is decreased by [oi], the 
smallest integer greater or equal to a^. That is, 
hi ^ hi — [oi] . These [a^] toppled grains jump to 
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[oj] randomly chosen nearest neighbors of vertex i: 
hj —^hj + ^. 

(iii) If for all these [a^] vertices, the resulting hj < Oj, 
then the "avalanche" process finishes. Otherwise, 
the vertices with hj > aj are updated in parallel 
(!), hj —^ [flj] , their randomly chosen neighbors 
receive grains, and so on until the avalanche stops. 
Then repeat (i). 

Note that the particular, "deterministic" case of 77 = 0, 
where all nearest neighbors of an activated vertex receive 
grains (as in the BTW model) essentially differs from the 
case of 1] > 0, where [a^] < g;. 

As is usual in SOC problems, the statistics of 
avalanches was studied: the size distribution Ps{s) ~ s~'^ 
for the avalanches (the "size" is here the total number 
of toppling events in an avalanche) and the distribu- 
tion Vt{t) ^ of their durations. (The distribution of 
the avalanche area — the number of vertices involved — is 
quite similar to Vsis)-) Taking into account the tree- 
like structure of uncorrelated networks, one can see that 
(i) an avalanche in this model is a branching process, 
avalanches are trees, (ii) the duration of an avalanche t 
is the distance from its root to its most remote vertex, 
and (iii) the standard technique for branching processes 
is applicable to this problem. 

The basic characteristic of the avalanche tree is the 
distribution of br anching, p {q). According to lGoh et al\ 
(|2005l) : iLee et al\ (|2004ai bri. p{q) = pi{q)p2{q). The first 
factor is the probability that q — 1 < a < q, that is 
q grains will fall from a vertex in the act of toppling. 
P2{q) is the probability that before the toppling, the 
vertex has exactly q — I grains. The assumption that 
the distribution of h is homogeneous gives the estimate 
^2(9) I/q- As for pi{q), one must take into account 
that (i) the degree distribution of an end of an edge is 
qP{q)/{q), (ii) P{q) ^ q~^ , and (iii) a = q^^^. As a re- 
sult, pi{q) ~ q-if-^-v)/a-v)^ Thus, the distribution of 
branching is p{q) ~ g-(7-2»?)/(i-j)) ^ ^-7 ^ One can see 
that if p2{q) = l/q, th en qp{ q) = 1. 

iGoh et al. I (|2003t) : iLee et al\ (|2004allbl ) applied the 
standard technique to the branching process with this 
piq) distribution and arrived at power-law size and dura- 
tion distributions, which indicates the presence of a SOC 
phenomenon for the assumed threshold a = q^^^ . They 
obtained exponents t and 5. With these exponents, one 
can easily find the dynamic exponent z — {5 — \ ) / {t — 1) 
(the standard SOC scaling relation), which in this case 
coincides with the fractal dimension of an avalanche. 
The results are as follows. There is a threshold value, 
7c 3 — ?/, which separates two regimes: 



if 7 > 3-77, then r = 3/2, S = z = 2, 



(154) 



if 2<7<3-77, then r = J = z = ^-^-^.(155) 



7-1-7? 



7-2 



that this z exactly coincides with the fractal dimension of 
equilibrium connected trees with the degree (or branch- 
ing) distribution equal to p{q) ~ q^'^ , see Sec. III. CI 

For the numerical stu dy of the BTW model on 
small- world networks, see Ide Arcangelis and HerrmannI 
(|2002D . The BTW model is one of numerous SOC 
models. There were a few studies of other SOC 
models on complex networks. For example, for the 
Olami-Feder-Christensen model on various networks, see 
ICaruso et o.l\ (|2006l I20n7^ ■ and for a Manna type sand- 
pile m odel on small-world networks, see Lahtincn et oH 
(I2OO5D . The Bak-Sneppen model on networks was 
studied in iKulkarni et al} (* 1999l ). Moreno and Vazguej 



(20021 .Masuda et al. (20051 and lLee et a/.l (|2005bf ) 



B. Cascading failures 

Devastating power blackouts are in the list of most 
impressive large-scale accidents in artificial networks. In 
fact, a blackout is a result of an avalanche of overload 
failures in power grids. A very simple though represen- 
tative mo del of a cascade of o verload failures was pro- 
posed bv lMotter and Lail (|2002D . The load of a vertex in 
this model is betweenness centrality — the number of the 
shortest paths between other vertices, passing through 
the vertex. Sec. III.Al Note that freq uently the betwe en- 
ness centrality is simply called load ( Goh et all . l200lf ). 

For every vertex i in this model, a limiting load — 
capacity — is introduced: 



(l + a)&o,, 



(156) 



It is easy to understand these results for the fractal 
dimension of an avalanche, z. The reader may check 



where boi is the load (betweenness centrality) of this ver- 
tex in the undamaged network. The constant a > is a 
"tolerance parameter" showing how much an initial load 
can be exceeded. A cascading failure in this models looks 
as follows. 

(i) Delete a vertex. This leads to the redistribution of 
loads of the other vertices: 6oi ~> &oi- 

(ii) Delete all overloaded vertices, that is the vertices 
with > a. 

(iii) Repeat this procedure until no overloaded vertices 
remain. 

In their simulations of various networks, Motter and 
Lai measured the ratio G = 7Vafter/A^, where N and A/'after 
are, respectively, the original number of vertices in a net- 
work and the size of its largest connected component after 
the cascading failure. (Assume that the original network 
coincides with its giant connected component.) Result- 
ing G{a) depend on (i) the architecture of a network, 
(ii) the parameter a, and (iii) characteristics of the first 
failing vertex, e.g., on its degree. 

In a random regular graph, for any a > 0, G is 1, and 
only if a = 0, the network will be completely destroyed, 
G = 0. On the other hand, in networks with heavy-tailed 
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degree distributions, G strongly depends on the degree 
(or the load) of the first removed vertex. Motter and Lai 
used a scale-free network with 7 = 3 in their simulation. 
Let us briefly discuss their results, a — Q gives G = for 
any starting vertex in any network, while a — *■ 00 results 
in G = 1. The question is actually about the form of 
the monotonously growing curve G{a). When the first 
removed vertex is chosen at random, the cascade is large 
(G strongly differs from 1) only at small a, and G(a) 
rapidly grows from to 1. If the first vertex is chosen 
from ones of the highest degrees, then G gently rises with 
a, and cascades may be giant even at rather large a. 

iLee et al\ ( 2005a| ) numerically studied the statistics of 
the cascades in this model defined on a scale- free network 
with 2 < 7 < 3 and found that in this case, there is a 
critical point ac ~ 0.15. At a < ac, there are giant 
avalanches, and at a > ac, the avalanches are finite. 
These authors observed that at the critical point, the size 
distribution of avalanches has a power-law form, V{s) ^ 
s""^, where exponent r w 2.1(1) in the whole range 2 < 
7 < 3. 

This model can be easily generalized: a may be de- 
fined as a random variable, instead of betweenness cen- 
trality o ther c haracteristics may be used, etc. — see, e.g., 
Motteil (12004 or, for a model with overloaded links, 
Moreno et all (|2003l) and lBakke et al\ (|2006l ). Note that 
there a re other appr oaches to cascading failures. For ex- 
ample, l^^tti ( 2OO2I ) proposed a model where, in simple 
terms, cascading failures were treated as a kind of epi- 
demic outbreaks. 



C. Congestion 

Here we only touch upon basic mo dels of jamming and 
conge stion proposed by physicists. lOhira and Sawataril 
( 19981 ) put forward a quite simple model of congestion. 
Originally it was defined on a lattice but it can be easily 
generalized to arbitrary network geometries. 

The vertices in this model are of two types — hosts and 
routers. Hosts send packets at some rate A to other (ran- 
domly chosen) hosts, so that every packet has its own 
target. Each packet passes through a chain of routers 
storing and forwarding packets. There is a restriction: 
the routers can forward not more than one packet per 
time step. The routers are supposed to have infinite 
buffer space, where a queue of packets is stored. The 
packet at the head of the queue is sent first. A router 
sends a packet to that its neighboring router which is 
the closest to the target. If there occur more than one 
such routers, then one of them is selected by some special 
rules. For example, one may choose the router with the 
smallest flow of packets through it. 

In their simulations Ohira and Sawatari studied the 
average time a packet needs to rich its target versus the 
packet injection rate A. It turned out that this time 
strongly rises above some critical value Ac, which indi- 
cates the transition to the congestion phase. The obser- 



vations of these authors suggest that it is a continuous 
transition, without a jump or hysteresis. The obvious 
reason for this jamming transition is the limited forward- 
ing capabil ities of ro u ters— one packet per time step. 

ISole and Valverdd (l200lh investigated this transition 
in the same model. They numerically studied the time- 
series dynamics of the number of packets at individual 
routers, and found a set of power laws at the critical 
point. In particular, they observed a l//-type power 
spectrum of these series and a power-law distribution of 
queue lengths. [Similar critical effects were found in an 
analytically treatable mod el of traffic in networks with 
hierarchical branching, see [Arenas et al. 1 (120011) .] They 
proposed the following idea. Since the traffic is most 
efficient at Ac, the Internet self-organizes to operate at 
criticality. This results in various self-similar scaling phe- 
nomena in the Internet traffic. 

These attractive ideas became the subject of strict crit- 
icism from computer scientists (Willinger et al., 2002). 
Let us dwell on this criticism, all the more so that it 
was from the di scoverers of the sca ling properties of the 
Internet traffic (jLeland et al\ . Il994j ). They wrote: "self- 
similar scaling has been observed in networks with low, 
medium, or high loads, and any notion of a "magical" 
load scenario where the network has to run at critical 
rate Ac to show self-similar traffic characteristics is in- 
consistent with the measurements" . They listed very 
simple alternative reasons for these self-similar phenom- 
ena. This criticism was, in fact, aimed at a wide circle 
of self-organized criticality models of various aspects of 
the real Internet, proposed by physicists. Willinger et al. 
stressed that these models "are only evocative; they are 
not explanatory" . In their definition, an evocative model 
only "can reproduce the phenomenon of interest but does 
not necessarily capture and incorporate the true under- 
lying cause" . On the other hand, an explanatory model 
"also captures the causal mechanisms (why and how, in 
addition to what)." Ask yourself: how many explanatory 
m odels of real ne t works were proposed? 

iGuimera et al\ (|2002l ) developed an analytical ap- 
proach where search and congestion problems were in- 
terrelated. In their simple theory the mean queue length 
at vertices of a network was related to a search cost in 
this network. The latter is the mean number of steps 
needed to find a target vertex. In this approach, mini- 
mizing the mean queue length is reduced to minimizing 
the search cost. This approach was used to find optimal 
n etwork architectu res with minimum congestion. 

lEchenique et al\ ({2005. ') introduced a model of network 
traffic with a protocol allowing one to prevent and relieve 
congestion. In their model, routers forward packets, tak- 
ing into account the queue lengths at their neighbors. 
Namely, a packet is sent to that neghboring router j, 
which has the minimum value 



5j — Mjt + (1 — h)cj. 



(157) 



Here £jt is the length of the shortest path from router j 
to the target of the packet, Cj is the queue length at the 
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FIG. 40 Order parameter p versus the packet i njecti on rate 
A for varios h in the m odel of lEcheniaue et al\ (j2005l ). From 
lEchenique et al\ (|2005l '). 



router, and the parameter h is in the range < h < 1. 
Echenique et al. performed the numerical simulations by 
using the map of a real Internet network but their results 
should be also valid for other architectures. As an order 
parameter for congestion they used the ratio: p = (the 
number of packets that have not reached their targets 
during the observation)/(the total number of packets 
generated during this time period). It turned out that 
if the parameter h is smaller than 1, then the transition 
to the congestion phase occurs at an essentially higher 
rate Ac. Furthermore, when h < 1, the order parameter 
emerges with a jump as in a first order phase transition, 
while at /i = 1 the transition resembles a usual second 
order phase transition, see Fig. 201 Remarkably, the loca- 
tions of these transitions, as well as the whole curves p(A), 
practically coincide at the studied h = 0.95, 0.75, 0.5. 
On the other hand, the congestion p at ft- < 1 is much 
higher than at /i = 1 at the same A > Ac. The routing 
protocol of Echenique et al. was explored and generalized 
in a nu mber of studies. For one of possib l e gene raliza- 
tions see lLiu et all (|2006D and lZhang al\ (|2007[ ). 

Another approach to network traffic, treating this 
process in ter ms of specifi c diffusi on of packets, was 
develo p ed by T^dic et al] (i2007i ): iTadic and Thurneil 
(|2004D : iTadic et al\ (|2004l) . see also I Wang et al\ (|2006[ ). 
The theory of this kin d of t raffi c was elabor at ed b 
iFronczak and Fronczad (|2007l ). iDanila et all ([200 
studied routing based on local information. They con 



sidered "routing rules with different degrees of conges- 
tion awareness, ranging from random diffusion to rigid 
congestion-gradient driven flow" . They found that the 
strictly congestion-gradient driven routing easily leads to 
jamming. .Carmi et al. (2006a) presented a physical so- 
lution of the probl em of effective routing with minimal 
memory resources. iToroczkai and Bassleil (|2004l ) investi- 
gated th e influence of network architectures on the con- 
gestion. iHelbing et all ( 2007t ) described the generation 
of oscillations in network flows. iRosvall et all (|2004l ) dis- 



cussed how to use limited information to find the optimal 
routes in a network. F or the problem of optimizati on of 
network flows, see also lGourlev and JohnsonI ( 2006( ) and 
references therein. 



XII. OTHER PROBLEMS AND APPLICATIONS 

In this section we briefly review a number of critical 
effects and processes in networks, which have been missed 
in the previous sections. 



A. Contact and reaction-difFuslon processes 

1. Contact process 



The contact process (iHarrisl . I1974D is in a wide 
class of models exhibiting non-equilibrium phase transi- 
tions, for example, the SIS model of epidemics, which 
belong to the directed per c olatio n universality class 
(iGrassberger and de la Torrd . I1979D . see the review of 
iHinrichsenI (| 2000'). The contact process on a network 
is defined as follows. An initial population of particles 
occupies vertices in a network. Each vertex can be oc- 
cupied by only one particle (or be empty). At each time 
step t, a particle on an arbitrary chosen vertex either (i) 
disappears with a probability p or (ii) creates with the 
probability 1 — p a, new particle at an arbitrary chosen 
unoccupied neighboring vertex. 

Let us introduce an average density Pq(t) of particles 
at vertices with degree q. The time evolution of Pq{t) is 
given by the mean-field rate equation: 



dpqjt) 
dt 



-ppq{t) + {l-p)q[l - p^{t)]Y,pAt)^^-^ 

q' 



(158) 

where P{q'\q) is the conditional probability that a ver- 
tex of degree q is connected to a ver tex of degree q' 
( Castellano and Pastor-Satorrasl l2006al) . The first and 
second terms in Eq. (|158p describe disappearance and 
creation of particles, respectively, at vertices with degree 
q. The factor 1/q' shows that a new particle is created 
with the same probability at any (unoccupied) nearest 
neighboring vertex of a vertex with degree q' . Recall 
that in uncorrelated networks, P{q'\q) = q'P{q')/{q). 

Equation (|158|) shows that if the probability p is larger 
than a critical probability pc, then any initial population 
of particles disappears at t — > oo, because particles dis- 
appear faster then they are created. This is the so called 
absorbing phase. When p < pc, an initial population of 
particles achieves a state with a non-zero average density: 



^P(g)p,(<-^oo)cxe^, 



(159) 



where e — Pc ^ p. This is the active phase. In the con- 
figuration model of uncorrelated random networks, the 
critical probability pc = 1/2 does not depend on the 
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degree distribution while the critical exponent (3 does. 
In networks with a finite second moment (5^) we have 
(3 = 1. If ((7^) ^00, then (3 depends on the asymp- 
totic behavior of the degree distribution at g ^ 1. If the 
network is scale-free with 2 < 7 < 3, the exponent (3 is 
1/(7 — 2). This critical behavior occurs in the infinite size 
limit, N 00. In a finite network, p is very small but 
finite at all p > and it is necessary to use the finite-size 
scaling theory. 

iHa et al\ (|2007t ) and iHong et al\ (|2007at ) applied the 
mean-field finite-size scaling theory to the contact pro- 
cess on finite networks (see Sec. lIX.Bt . They showed that 
near the critical point pc the average density p behaves 
as p{e,N) = iV-'3/^/(eiVi/^), where f{x) is a scaling 
function, the critical exponent (3 is the same as above. 
The critical exponent V depends on degree distribution: 
F(7 > 3) = 2, and F(2 < 7 < 3) = (7 - l)/(7 - 2). 
The authors carried out Monte Carlo simulations of the 
contact process on the configuration model of uncorre- 
lated scale-free networks of size to iV = 10^. These sim- 
ulations agreed well with the predictions of the mean- 
field scaling theory in contrast to earlier calcu lations of 
ICastellano and Pastor- Satorrad (|2006all2007b^ . 



Based on the phcnomenological theory of equilibrium 
critical ph enomena in complex networks (Sec. IIX.A[) . 
iHong etal. (2QQ7a) proposed a phcnomenological mean- 
field Langevin equation which describes the average den- 
sity of particles in the contact process on uncorrelated 
scale- free networks near the critical point: 



dpjt) 
dt 



ep — bp — dp 



(160) 



where r](t) is the Gaussian noise, b and d are constants. 
Note that the contact process contains the so-called 
multiplicative noise y/prj{t), in contrast to an equilib- 
rium process wit h a thermal Gaussian noise (see, e.g., 
iHinrichsenI (|2000l )). Neglecting the noise in Eq. in 
the steady state one can obtain the critical behavior of 
p and a finite-size scaling behavior of the relaxation rate 
fSec. lIX.Bj) . As is natural, when a degree distribution is 
rapidly decreasing, this finite-size scaling coincides with 
that for the contact process on high-dimensional lattices 
([Ltibeck and Janssenll2005l ). 

The time e volution of the average densi t y p{t) 
was st udied by Castellano and Pastor-SatorrasI ( 2006al 
|2007b) and ' Hong et al\ (|2007aD . When v ^ Vr. in an 
infinite network, an initial population of particles expo- 
nentially relaxes to a steady distribution. The relaxation 
time tc is finite. At the critical point, p = pc, the char- 
acteristic time tc diverges, and an initial distribution de- 
cays as p{t) ^ t^^. Exponent 6* = 1 for an uncorrelated 
complex network with a finite second moment (9^), and 
9 = 1/(7 — 2) for a scale-free network with 2 < 7 < 3. In 
a finite network, tc(iV) is finite even at the critical point. 
In uncorrelated networks with (^q^^ < 00, the character- 
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FIG. 41 Relative density of particles B versus the total den- 
sity of A and B particles in the reaction-difltusion model in 
scale-free networks at /i/A = 2. Rightmost curves [A particles 
are non-diflusing) : stars, = 10*, 7 = 3; closed diamonds, 
iV = 10", 7 = 2.5; open circles, iV = 10^, 7 = 2.5. Leftmost 
curves (both A and B particles are diffusing, 7 = 2.5): open 
squares, = 10^; close d squares, = lO'* ; open triangles, 
iV = 10^ Adapted from lColizza et al\ (120071 1. 



istic relaxation time is 



(161) 



( Castellano and Pastor-SatorrasI l2007b[ ). Note that 
when exponent 7 > 3, the phcnomenological approach 
based on Eq. (fTBO)) also leads to t^ oc N'^/'^. The 
size dependence of tc in the range 2 < 7 < 3, 
wh ere jq^) depends on N, is sti l l unde r discussion 



see 



Castellano and Pastor-SatorrasI ( 2007bf) : iHong et'oM 



(l2007aD. 

iGiuraniuc et al\ (|2006^ considered the contact process 
with a degree dependent rate of creation of particles 
assumed to be proportional to {qiqj)~^, where /i is a 
tunable parameter, qi and qj are degrees of neighbor- 
ing vertices. Using a mean-field approximation which is 
equivalent to the annealed network approximation, they 
showed that this degree dependent rate changes the crit- 
ical behavior of the contact process in scale-free net- 
works. The result is the shift of degree distribution ex- 
ponent 7 to 7' = (7 — /i)/ (7 — 1). This effect is similar 
to the Ising model with degree dependent interactions 
in Sec. I VI. C. 51 For finite-size scaling in contact pro- 
cesses with this de gree- dependent rate of creation, see 
iKarsai et d] (|2006l ). 



2. Reaction-diffusion processes 

Reaction-diffusion processes on uncorrelated random 
complex networks were studied bv lCohzza et al\ ([2007). 
Consider the following process for particles of two types, 
A and B. In an initial state, particles are distributed 
randomly over vertices of a network. There may be an 
arbitrary number of these particles at any vertex. Sup- 
pose that only particles at the same vertex may react and 
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transform to other particles. The rules of this transfor- 
mation are the following: 

(i) Each particle B can spontaneously turn into a A 
particle at the same vertex at a rate /i: B A. 

(ii) Particles A and B can transform into two B parti- 
cles at the same vertex at a rate A: A + B ^ 2B. 

(iii) Particles B can hop to neighboring vertices at the 
unit rate. 

These reactions preserve the total number of particles in 
the system. The steady state of this process strongly 
depends on a supposed behavior of particles A. 

If A particles are non-diffusing and the total density of 
A and B particles, p, is smaller than the critical density 
Pc — Ai/A, then B particles disappear in the limit t ~^ oo 
(this is the absorbing phase). At p > pc there is a non- 
zero density of B particles, pb, in the steady sta t e (this 
is the active phase), see Fig. STJ IColizza et all ( 20071 ) 
showed that pc and the critical behavior do not depend 
on the degree distribution. 

If A particles can also hop, then the phase transition 
into the active phase occurs at a degree dependent critical 
density pc — (q)^/i/(((7^)A). In networks with divergent 
{q^), Pc is zero in the limit N oo, see Fig.HTJ A similar 
disappearance of the critical threshold was observed in 
percolation and the spread of diseases. 

Network topology strongly affects dynamics of the 
diffusion-annihilation process. This process is defined in 
the following way. Identical particles diffuse in a net- 
work. If two particles a re at the same ve r tex, t hey an- 
nihilate {A + A 0). ICatanzaro et al\ (|2005l ) within 
the mean-field theory showed that in infinite uncorre- 
lated random networks the average density of particles, 
p{t), decreases as t~°' at large times, where the exponent 
a — 1 for a network with a finite second moment (9^), 
and a = 1/(7 — 2) for an uncorrelated scale-free network 
with degree distribution exponent 2 < 7 < 3 (i.e., with 
divergent (9^))- However, in a finite scale-free network, 
there is a crossover to the traditional mean field behavior 
1/t at times t > tc{N), where the crossover time tc{N) 
increases with increasing iV. Thus the non-mean-field 
behavior with a = 1/(7 — 2) may be observed only in a 
sufficiently large network (see Iben-Avraham and Glasseil 
|2007) for a discussion of kinetics of coalescence, A+A^ 
A, and annihilation, A + A 0, beyond the mean- 
field approximation in the Bet he lattice). Thi s agree s 
with numerical simulations of ICatanzaro et al. I (|2005D : 
iGallos and ArgvrakisI (|2004D . 



B. Zero-range processes 

Zero-range process describes non-equilibrium dynam- 
ics of condensation of interacting particles in lattices and 
networks. This process is closely related to the balls- 
in-boxes model ( Bialas et a/.l. ll997 ) and equilibrium net- 
work ensembles ([Angel et all l2005l 120061 : iBurda et all 



I2OOII: iDorogovtsev et al. discussed in Sec. IIV.AI 

The interested reader w ill find a review of several appli- 
cations of this model in lEvans and HannevI (|2005D . 

In the zero-range process, identical particles hop be- 
tween vertices on a graph with a rate u{n) which depends 
on the number of particles, n, at the vertex of departure. 
The total number of particles is conserved. In fact, an in- 
teraction between particles on the same vertex is encoded 
in the function u(n). The case u(n) cx n corresponds to 
noninteracting particles. If u{n) increases faster than n, 
then we deal with a local repulsion. If u{n) decreases 
with n, then it assumes a local attraction. Emergence of 
the condensation depends on the hop rate u(n) and the 
network structure. 

The system evolves from an initial distribution of parti- 
cles to a steady state. At a certain condition, the conden- 
sation of a finite fraction of particles occurs onto a single 
vertex. Note that this non-equilibrium phase transition 
occurs even in a one-dimensional lattice. In the steady 
state the distribution of particles over vertices can be 
found exactly. The probability that vertices i = 1, 2, ...TV 
are occupied by rii, ^2, ... tln particles is 



N 



V{ni,n2, ...nN) =^J|/i(»- 
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where A is a normalization constant, the function 
.fi(n) = Y\l--,\uJi/u(Tn)] ioT n > 1, and /j(0) = 1 
()Evans and Haniievl . |2005| ) . The parameters cji are the 
steady state weights of a single random walker which 
moves on a given network. In simple terms, the frequency 
of visits of the walker to a vertex is proportional to its 
weight. The weights satisfy the equation uji = cOjTji, 
where Tji is a rate of particle hops from vertex j to neigh- 
boring vertex i. Using the function Eq. (jl62p . one can 
find exact mean occupation numbers of vertices. 

Let us first consider a homogeneous system where all 
vertices have the same degree. The condensation is ab- 
sent if u(n — > 00) —^ 00. In the steady state all vertices 
have the same average occupation number (this is the so 
called fluid phase). The condensation occurs if u{n) de- 
cays asymptotically as m(oo)(1 -|- b/n) with b > 2. In this 
case, the steady state with the condensate emerges when 
the concentration of particles p is larger than a critical 
concentration pc determined by the function u{n). In 
the condensed phase, a finite fraction of particles, p~ pc, 
occupies a single vertex chosen at random. All other ver- 
tices are occupied uniformly with the mean occupation 
number pc- If u{n — s- 00) — 0, then pc = 0. 

The zero-range process in uncorrelated scale-free net- 
works with degree distribution expon ent 7 > 2 was stud- 
ied by[No3 (|2005l ): iNoh et all (|2005l) . The authors con- 
sidered the case when the function u{n) = . A particle 
can hop with the same probability to any nearest neigh- 
boring vertex, i.e., the transition probability — 1/qi, 
where qi is degree of departure vertex i. In this case 
LUi ~ qi. It was shown that if d > Sc — 1/(7 — 2), then 
the steady state is the fluid phase at any density of parti- 
cles. If (5 < Sc, then the critical concentration pc — 0. At 
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p > 0, in the steady state, almost all particles are con- 
densed not at a single vertex but a set of vertices with de- 
grees exceeding Qc = [qcutiN)]^'^^^" . These vertices form 
a vanishingly small fraction of vertices in the network in 
the limit N ^ oo. Note that these results were obtained 
for the cutoff qcut{N) — A^^/^t^^) (see the discussion of 
qcntiN) in Sec. III.E.4p . When 6 = 0, then = gcut(iV) 
and all particles con dense at a vertex with the highest 
degree qcut{N). See iTang et all ( 2006t ) for specifics of 
condensation in a zero-range process in weighted scale- 
free networks. 

The steady state in the zero-range process on a scale- 
free network is completely determined by the degree dis- 
tribution. The topological structure plays no role (i.e., it 
does not matter whether vertices are arranged in a finite 
dimensional system or form a small world). It is assumed 
that the network structure may influence relaxation dy- 
namics of the mode l, unfortunately, no exact results are 
known. iNohl studied the evolution of an initial 

distribution of particles to the steady state and esti- 
mated the relaxation time r. In an uncorrelated random 
scale- free network, the relaxation time is t ~ , where 
2 = 7/(7— 1) — (5, while in clustered scale-free networks, 
this exponent is z = 1 — 6. This e st imate agrees wit h 
numerical simulations in iNohl (jlooi); iNoh et al\ (jlooi). 
Note that the scaling relation r ^ is also valid for a d- 
dimensional lattice. In this case the exponent z depends 
on both the dimension d and the probability distribution 
of hopping rates. Particularly, z = 2 for a d > 2-regular 
lattice (Evans a nd Hanncy, 2005.). 

In a finite network, the condensate at a given vertex 
exists a finite time Tra{N). After "melting" at this ver- 
tex, the condensate appears at another vertex, then — at 
another one, and so on. For a homogeneous network, e.g., 
for a r andom regular graph, Tm ~ ^ t ~ , where 



z' > z. iBogacz et all (|2007al lbh: IWaclaw et al\ (|2007l ) ar- 
gued that in heterogeneous systems the typical melting 
time of the condensate, Tm{N), increases exponentially 
with N, i.e., r„j(iV) ~ e'^^, in contrast to a homogeneous 
system. The zero-range process relaxes slowly to the con- 
densed phase in comparison to a relaxation time to the 
equilibrium state in the ferromagnetic Ising model. (The 
relaxation time of the Ising model is finite at all tempera- 
tures except the critical one, at which it scales with TV as 
A^", see Sec. lIX.Bl ) As soon as the condensate is formed, 
it exists for an exponentially long time at a vertex of the 
network: t™ e^^^ > r iV^. 



C. The voter model 



According to ISood and Redned (jlooi), "the voter 
model is perhaps the simplest and most completely solved 
example of cooperative behavior" . In this model, each 
vertex is in one of two states — spin up or spin down. In 
the vertex update version of the model, the evolution is 
defined as follows. At each time step, 

(i) choose a vertex at random and 



(ii) ascribe to this vertex the state of its randomly cho- 
sen neighbor. 

The evolution in the voter model starts with some ran- 
dom configuration of up and down spins, say, with a frac- 
tion of riQ spins up. One can see that this evolution is 
determined by random annihilation of chaotic interfaces 
between "domains" with up and down spins. In a finite 
system, there is always a chance that the system will 
reach an absorbing state, where all spins up (or down). 
However, on the infinite regular lattices of dimensionality 
greater than 2, the voter model never reaches the absorb- 
ing states staying in the active state for ever. For the 
voter model on the finite regular lattices of dimension- 
ality greater than 2, t he mean time t o re ach consensus 
is Tat ~ iV (iben-Avraham et aZ.I . Il990l : iKrap ivskv. 1992). 
Here iV is the total number of vertices in a lattice. 

On the other hand, the i nfinite one-dimensional voter 
model evolves to conse i isus. Castellano et al\ ( 2003h and 
IVilone and Castelland (2004) studied the voter model on 
the Watts-Strogatz small-world networks and found that 
even a small concentration of shortcuts makes consensus 
unreachable in the infinite networks. This is quite natu- 
ral, since these networks are infinite-dimensional objects. 

It is important that the average fraction of spins up, 
n, conserves in the voter model on regular lattices, i.e., 
n{t) = uq = const. Here the averaging is over all ini- 
tial spin configuration s and over all evolution histories. 
ISuchecki e^"aLr(l2005al lbh found that on random networks. 



n(t) is not conserved. Instead, the following weighted 
quantity conserves: 



qPjq) f ^ 
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where n{q) is the average fraction of spins up among 
vertices of degree q. Thus, n{t) = no = const, where 
no = n{t = 0). Note that n is actually the probability 
that an end vertex of a randomly chosen edge is in state 
up. 

Based on this conservation, ISood and Redned (I2005D 
arrived at the following physical picture for the voter 
model on uncorrelated complex networks. Consensus is 
unreachable if these networks are infinite. In the finite 
networks, the mean time to reach consensus is finite. The 
evolution consists of two stages. The first is a short initial 
transient to an active state where at any particular evolu- 
tion history, the fraction of vertices of a given degree with 
spin up is approximately fiQ. In the slow second stage, 
coarsening develops, and the system has an increasing 
chance to approach consensus. The mean time to reach 
consensus is 

/„\2 

TN = Nfij^ [(l-no)ln(l-no)~i+nolnn^i] . (164) 

{q ) 

So, the theory of Sood and Redner gives (a) ^ N for 
uncorrelated networks with a converging second moment 
of a degree distribution, (b) r^r ~ N/ \nN in the case of 
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the degree distribution P{q) ^ q~^, and (c) r^r growing 
slower than N if (g^) diverges, i.e., if the degree distri- 
bution exponent is less than 3. In the last case, this size 
dependence (a power of N with exponent less than 1) is 
determined by a specific model-dependent cutoff of the 
degree distribution, qcut{N). 

Interestingly, in the second version of the voter 
model — edge update — the average fraction of up ver- 
tices is conserved as well as the mean magnetization. 
In the edge update voter model, at each time step, an 
end vertex of a randomly chosen edge adopts the state 
of the second end. In this model, the evolution of the 
system on a complex network is qualitatively the same 
as on high-dimensiona l regular lattices, and r^y ~ -/V 
( Suchecki et al. I. l2005allbh . 

Other basic types of spin dyna mics are also 

widely discussed. ICastellano et al. 1 dlooi) stud- 
ied a difference between the voter dynamics and 
the Glauber- Metropolis zero-temperature d y namics 
on networks ([Castellano and Pastor- Satorrasl l2006bl: 
IZhou and Lipowskvl. 2005f ). In the Glauber-Metropolis 
dynamics in application to the Ising model at zero tem- 
perature, at each time step, a randomly chosen spin gets 
an energetically favorable value, -1-1 or —1. In contrast 
to the evolution due to the interface annihilation in the 
voter model, in the Glauber-Metropolis dyna mics, do- 
main walls shorten diminishing surface tension. ISvensonl 
(120011) showed numerically that in infinite random net- 
works, the Glauber-Metropolis dynamics of the Ising 
model at zero temperatu re does not reach the ground 
state. iHaggstrdnil ()2002[ ) rigorously proved that this is 
true at least in the case of the Gilbert model of classical 
random graphs. Thus, this kind of dynamics can result in 
consensus only in finite networks, as in the voter model. 
Nonetheless, Castellano, et al. found that the voter and 
Glauber-Metropolis dynamics provide markedly different 
relaxation of spin systems on random networks. For the 
Glauber-Metropolis dynamics, the time dependence of 
the probability that a system does not yet reach con- 
sensus essentially deviates from exponential relaxation, 
typical for the voter dynamics. 

For detailed discussion of the voter model on com- 
plex networks in c ontex t of opinion formation, see 
IWu and HubermanI (|2004l ). For other nonequilibrium 
phenomena in complex networks modeling social i nterac - 
tion s, see. e.g.. lKlemni al\ (|2003( ). lAntal et al\ (|2005t ). 
and iBaroncheUi et all (|2007[) . 

A few numerical studies were devoted to non- 
equilibrium phase transitions in the ferromagnetic Ising 
model on directed complex networks with possible ap- 
plication to processes in social, economic, and biological 
systems. In the directed Ising model, the interactions 
between spins are asymmetric and directed, so a Hamil- 
tonian formulation is impossible. Each spin is affected 
only by those of its nearest neighboring spins which are 
connected to this spin by, say, outgoing edges. Using a 
directe d Watts-Stroga t z netw ork generated from a square 
lattice, ISanchez et ail (|2002l ) found that a ferromagnetic 



phase transition in this system is continuous at a suffi- 
ciently small density of the shortcuts. This transition, 
however, becomes of the first order above a critical con - 
centration of the shortcuts. iLima and Stauffeil (I2006D 
carried out simulations of the ferromagnetic Ising model 
on a directed Barabasi- Albert network at T = and 
found that different dynamics algorithms lead to differ- 
ent final states of the spin system. These first investi- 
gations demonstrate a strong influence of a directed net- 
work structure on the non-equilibrium dynamics. How- 
ever, these systems are not understood as yet. 



D. Co-evolution models 

We mostly discuss systems where a cooperative 
model does not i nfluen ce its network substrate. 
iHolme and Newma i (dooi) described a very interesting 
contrasting situation, where an evolving network and in- 
teracting agents on it strongly influence each other. The 
model of Holme and Newman, in essence, is an adaptive 
voter model and may be formulated as follows. There 
is a sparse network of A'^ vertices with a mean degree 
(q). Each vertex may be in one of G states — "opinions", 
where G is a large number (which is needed for a sharp 
phase transition). Vertices and connections evolve: at 
each time step, choose a random vertex i in state gi. If 
the vertex is isolated, do nothing. Otherwise, 



(i) with probability 0, reattach the other end of a ran- 
domly chosen edge of vertex i to a randomly chosen 
vertex with the same opinion gf, or 

(ii) with probability 1 — 0, ascribe the opinion gi to a 
randomly chosen nearest neighbor j of vertex i. 

Due to process (i), vertices with similar opinions become 
connected — agents influence the structure of the network. 
Due to process (ii), opinions of neighbors change — the 
network influences agents. 

Suppose that the initial state is the classical random 
graph with vertices in random states. Let the mean de- 
gree be greater than 1, so that the giant connected com- 
ponent is present. This system evolves to a final state 
consisting of a set of connected components, with all 
vertices in each of the components being in coinciding 
states — internal consensus. Of course, vertices in differ- 
ent connected components may be in different states. In 
their simulation, Holme and Newman studied the struc- 
ture of this final state at various values of the parameter 
(j). In more precise terms, they investigated the resulting 
size distribution P{s) of the connected components. 

li (f) — 0, the connections do not move, and the 
structure of the final network coincides with the original 
one, with the giant connected component. This giant 
component is destroyed by process (i) if the probability 
(j) is sufficiently high, and at ~ 1, the network is segre- 
gated into a set of finite connected components, each one 
of about N/G vertices. It turns out that at some critical 
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value (pc = ipciiq) , N/ G) there is a sharp transition, 
where the giant connected component disappears. At the 
critical point, P{s) seems to have a power-law form with 
a nonstandard exponent. There is a principle difference 
from the usual birth of the giant connected component 
in random networks — in this evolving system, the 
phase transition is nonequilibrium. In particular, this 
transition depends on the initial state of the system. 
We expect that models of this kind w ill attract much 
intere st i n the future, see works of [Caldarelli et al} 
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E. Localization transitions 



In this subsection we briefly discuss two quite different 
localization problems — quantum and classical. 



1. Quantum localization 

Here we touch upon the transition from localized states 
of an electron on the Erdos-Renyi graph, that is the 
quantum percolation problem. The set of corresponding 
eigenfunctions iJj(i,E), where E is the energy described 
by the hopping Hamiltonian, obeys the equations: 
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where a^- are elements of the adjacency matrix. So, the 
quantum percolation problem is in fact the problem of 
the structure of eigenvectors of the adjacency matrix and 
its spectrum. 

In the phase with dclocalized states, the spectrum 
{\E\ < C{q), wh ere C is some positive constant) is orga- 
nized as follows ( Harrisl . [l982l ). All states with Ec{{q)) < 
\E\ < C{q) are locahzed, where Ec is the mobility edge 
energy. On the other hand, in the range \E\ < Ec{{q)), 
both localized and extended are present. At the localiza- 
tion threshold, Ec becomes zero, and, as is natural, all 
the states are localized in the localization phase. This 
picture allows one to find the localization threshold by 
investigating only the zero energy states, since extended 
st ates fir s t eme rge at zero energy. 

iHarrisI ( 19821 ) (see also references therein) explained 
how to distinguish localized and extended states in the 
spectrum and how to relate the quantum percolation 
problem to classical percolation. It is important that 
he showed that the delocalization point, (/doioc, does not 
coincide with the classical percolation threshold (i.e., 
the point of the birth of the giant connected compo- 
nent, which is (q) = 1 in the Erdos-Renyi model). 



iBauer and Golinellil (|2001bD showed that the localization 
phase is at (q) < gdeioc = 1.421529 . . ., and above gdoioc 
the conducting phase is situated. They also revealed an- 
other, relocalization transition at a higher mean degree, 
9reioc = 3.154985.... This intriguing relocalization was 
observed only in this work. 

For numerical study of quantum localization in scale- 
free netwo r ks, w hich is a pretty difficult task, see 
ISade et all (|2005f) . This problem was not studied ana- 
lytically. 



2. Biased random walks 

Let a classical particle randomly walk on a graph. It 
is well known that on c?-dimensional lattices, (i) if d < 2, 
a walk is recurrent, that is a drunkard almost surely will 
get back to his home — "localization"; and (ii) if c? > 2, a 
walk is transient, that is with finite probability, it goes to 
infinity without returning to a starting point. Thus the 
dimension d = 2 may be interpreted as a "localization 
tr ansitio n". 

iLvonsI (|l99(Tf ) found and analytically described a 
very similar trans ition in random networks, see also 
iLvons et all i 1996[ ). Actually he considered random 
growing trees with a gi v en dis tribution of branching, but 
ISood and Grassberge 3 (I2007D showed that in networks 
with locally tree-like structure, nearly the same conclu- 
sions hold. For brevity, let the network be uncorrelated. 
Consider a random walk started from a randomly cho- 
sen vertex 0, assuming that there is an "exponential" 
bias in the direction of vertex 0. One may easily arrange 
this bias by labelling all vertices in the network by their 
shortest path distance to the starting vertex. Suppose 
that the probabilities of a jump of the walker from ver- 
tex i {£ steps from vertex 0) to its nearest neighbors at 
distances i — 1, i, or ^ -I- 1 are related in the following 
way: 



Pii-J- 



-1) p{i;£^£) 
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Then the localization transition is at Ac, coinciding with 
the mean branching coefficient B, which is, as we know, 
B — Z2/Z1 = (((7^) — {q))/{q) for the configuration model. 
It is exactly the same critical point as was observed in 
cooperative models on this network, see Secs. lIII.B.SI and 
IVI.C.4i which indicates a close relation between these two 
classes of problems. 

For 1 < A < Ac, the average return time grows propor- 
tionally to iV^ with exp onent e = ln(i?/A)/ In i3 , whic h 
is the analytical result of iBenichou and Voituriej ( 20071 ). 



At A = Ac, this time is oc InA'^ as in the unbiased ran- 
dom walks on the chain of length In N with the reflecting 
boundaries. Finally, for A > Ac, above the critical bias, 
the mean return time approaches a finite value at large 
iV. Remarkably, the average return time coincides with 
the mean correlation volume V, Sec. IIII.B.3[ if the pa- 
rameter b characterizing the decay of correlations is taken 
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t o be b = 1/A. 

ISood and Grassbergeil ( 200l1 ) measured the distribu- 
tion of return times and found that due to the absence 
of smaU loops in the network, returns with sufficiently 
short odd times are virtually absent for any bias. In other 
words, in this range of times, a walker may get back to 
the starting vertex only by the same way he walked away. 



F. Decentralized search 

Recall that in the Watts-Strogatz small-world networks 
with variation of the number of shortcuts, there is a 
smooth crossover from a lattice (large world) to a small 
world. In marked contrast to this are Kleinberg's net- 
works described in Sec. III. II as well as the long-range 
percolation problem. In these systems there is a sharp 
transition between the lattice and small-world geome- 
tries at some special value of the control parameter — 
exponent a, which de pends on the dimensional i ty d the 
lattic e substrate (.Beniainiiii and Bergeii 1200 ll : iBiskud . 
|2004 iMartel and Nguvenl . |2004| ). Inthese works ac- 
tually a closely related long-range percolation problem 
was analysed. Assuming that the number of shortcuts 
is 0(iV), i.e., the network is sparse, gives the following 
mean intervertex distances: 



(i) for a<d, £{N) - In TV; 

(ii) for d < a < 2d, I{N) - (IniV)*^"), where 5{a) ^ 
ln2/ln(2d/a) > 1; 

(iii) for a > 2d, 1{N) ^ c{a)N, where c{a) depends 
only on a. 

Thus, there is a sharp transition from a "large world" 
to a "small world" at a = 2c?. (Note, however, 
that iMoukarzel and de Menezed ( 2002f ) presented heuris- 
tic and numerical arguments that this transition is at 
a = d, and I ^ iV^^") for d < a < 2d, where < /i(a) < 
l/d. The reason for this difference between two groups 
of results is no t clear.) For other netw o rks w ith a similar 
transi tion, see iHinczewski and Berkeij ( 20061 ) and lHolini 
(I2007D . 

The sparse network with exponent a equ al to d is 
unique in the foll owing respect described by lKleinber3 
((i99i,[200S[2003). ileinberg asked: how many steps in 
average, t{N) > i{N), it will take to approach/find a tar- 
get from an arbitrary vertex by using the fast "decentral- 
ized search greedy algorithm"? This algorithm exploits 
some information about geographic positions of vertices: 
at each step, move to the nearest neighbor (including 
the neighbors through shortcuts) geographically closest 
to the target [fo r other search algorit hms based on local 
information, see lAdamic et all (|2003l )]. In particular, for 
d = 2: 




FIG. 42 Schematic plot of the mean intervertex distance 
£{N, a) and the mean search time t{N, a) vs. exponent a 
for sparse Kleinberg's network of fixed large size A'^, based on 
a d dimensional lattice. The network with a = d is searchable. 



(in) for a > 2, t{N) - Ar("-2)/(2a-2) ^ 

That is, a = d gives the best search performance (with 
this algorithm). In this respect, the network with a = d 
may be called "searchable" (see Fig. H^ . Remarkably, 
t{N) ^ £{N) in the searchable networks. 

A similar phen omenon was observe d also on trees with 
added shortcuts ( Watts et all |2002| ). In this situation, 
the probability that a shortcut connects a pair of ver- 
tices separated by r steps on the tree should be taken not 
power-law but exponential, proportional to exp(— r/^). 
With the same greedy algorithm, using "geographic po- 
sitions" of the vertices on the underlining tree, this net- 
work appears to be searchable at special values of the pa- 
rameter ^. Interestingly, the ferromagnetic Ising model 



placed on this network has lon g-range order on l y at z ero 

r ositive 
( 2007t) exactly described a transi- 



te mperature at any positive ^ (jWoloszvn et 



nlyatze 



(i) for < a < 2, t{N) - Ar(2~")/6; 

(ii) for a = 2, t{N) ^ In^ N (which is also valid for 
general a = d); 



tion from a small world to a large one in growing trees 
with a power-law aging. Remarkably, they found that 
1{N) ^ In^ N at the point of this transition similarly to 
a searchability point in Kleinberg's networks. This sug- 
gests that the tree ansatz works at a searchability point 
of Kleinberg's networks. 



G. Graph partitioning 

The size of this article does not allow us to touch upon 
each of studied transitions in various networks. In the 
end of this section, we onl y mention a phase transition 
found bv Paul et all (|2007l ). They studied the following 
problem: partition a graph by removing a fraction 1—p of 
edges in a way minimizing the size of the largest partition, 
S. This problem is related to the optimal immunization 
strategy for a complex network. In the random regular 
graph with the coordination number q, all partitions are 
small ii p < Pc ~ 2/q, where Pc does not coincide with 
the usual percolation threshold, l/{q — 1). On the other 
side of the threshold, the largest partition turns out to 
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be giant, 5 ~ iV. Moreover, in contrast to percolation, 
as the fraction p of retained edges decreases, a sequence 
of jumps in S — a sequence of "transitions" — takes place. 



The effect of structural correlations in a complex network 
on collective phenomena is also a little studied problem. 



XIII. SUMMARY AND OUTLOOK 
A. Open problems 

We would like to indicate a few directions of par- 
ticular interest among those discussed in this arti- 
cle. The first one is the synchronization in the Ku- 
ramoto model on complex networks, for which there 
is no solid theory. The second direction is the co- 
evolvii ig networks and interacting systems defined o n 
them ( Holme and Newmanl [2006t iPacheco et al. 
We did not discussed a number of interesting NP opti- 
mization problems which were studied by tools of statis- 
tical physics but were considered only for classical ran- 
dom graphs. Among them, there were sparse graph error 
correcting codes (see, e.g., Montanari (200.5) and refer- 
ences ther ein), phase transi t ions i i i random satisfiability 
problems (lAch lioptas et all 2005 Krzakala et all 120071 : 
iMertens oZT 2003: M czard a/.l . l2002l ). and combina- 
torial auctions (Galla et ali 1200^ . Note that the color- 
ing graph problem and minimum vertex covers were also 
not analysed for complex networks. Finally, we add to 
our list the tough but, we believe, doable problem of find- 
ing a replica-symmetry breaking solution for a spin glass 
on a complex network. 

Real-life networks are finite, loopy (clustered) and cor- 
related. Most of them are out of equilibrium. A solid 
theory of correlation phenomena in complex networks 
must take into account finite-size effects, loops, degree 
correlations and other structural peculiarities. We de- 
scribed two successful analytical approaches to coopera- 
tive phenomena in infinite networks. The first was based 
on the tree ansatz, and the second was the generaliza- 
tion of the Landau theory of phase transitions. What is 
beyond these approaches? 

Several first methodical studies aiming at strict 
accountinff for l oo ps were p erformed recently, see 
Montanari (|2005|). iMontanari a nd Rizzo (2005,), and 



Chertkov and ChernvakI (|2006allbl V The approximations 



and loop expansions proposed in these works were not 
applied to complex networks yet. Rather, it is a tool 
for future work. It is still unknown when and how loops 
change cooperative phenomena in complex networks. 

The tree ansatz usually fails in finite networks. In this 
respect, the problem of a finite size network is closely 
related to the problem of loops. It is technically diffi- 
cult to go beyond intuitive estimates of finite-size effects 
demonstrated in Sec. IIII.B.41 and the finite-size scaling 
conjecture. The strict statistical mechanics theory of fi- 
nite networks is still not developed. 

Despite some number of interesting results, coopera- 
tive models on growing networks are poorly understood. 
As a rule, it is still impossible to predict the type of a 
critical phenomenon in an interacting system of this kind. 



B. Conclusions 

We have reviewed recent progress in critical phenom- 
ena in complex networks. In more precise terms, we have 
considered critical effects in a wide range of cooperative 
models placed on various networks and network models. 
We have demonstrated a number of diverse critical ef- 
fects and phenomena, which greatly differ from those in 
lattices. It turns out, however, that each of these phe- 
nomena in networks, in principle, can be explained in the 
framework of a unified approach. This unified view has 
been presented in this article. 

We have shown that in simple terms, the brand new 
appearance of critical phenomena is determined by the 
combination of two factors — the small-world effect and 
a strong heterogeneity and complex architecture of net- 
works. The compactness of networks leads to Gaussian 
critical fluctuations, and in this respect, the theory of 
phase transitions in networks is even more simple than 
in low-dimensional lattices. On the other hand, the com- 
plex organization of connections makes these critical phe- 
nomena far more rich and strayed from those predicted 
by the traditional mean-field theories. 

It was claimed only four years ago that " the study 
of com plex networks is still in its infancy" ( Newmanl . 
l2003al ). Now the baby has come of age. Nonetheless, we 
have indicated a wide circle of open problems and chal- 
lenging issues. We stress that in contrast to the impres- 
sive progress in understanding the basic principles and 
nature of the critical phenomena in networks, progress 
in the application of these ideas to real-world netw orks is 
rather modest (though see, e.g., the work of Colizza et all 
(I2007D ). There is much to be done in this direction. 

Complex networks are ultimately compact, maximally 
disordered, and heterogeneous substrates for interacting 
systems. Importantly, these network systems are among 
the fundamental structures of nature. The phenomena 
and processes in these highly nontraditional systems re- 
markably differ from those in ordered and disordered lat- 
tices and fractals. This is why the study of these intrigu- 
ing effects will lead to a new understanding of a wide 
circle of natural, artificial, and social systems. 
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APPENDIX A: BETHE-PEIERLS APPROACH: 
THERMODYNAMIC PARAMETERS 



a) 



The Bethe-Peierls approximation in Sec . I VI . A . 1 1 allows 
us to calculate a number of important thermodynamic 
parameters. The correlation function C'ij = (SiSj) be- 
tween two neighboring spins is 

'tanh f3hji tanh (3hij ' 



Cij = tanh|/3Jy + tanh 



tanh pji. 



(Al) 

Notice that Cij is completely determined by the messages 
hij and hji which two neighboring spins, i and j, send 
to each other. Knowing Cij and Mi, we find the internal 
energy 



and the free energy (jMezard and Parisil [200lh 



(A2) 



where 

^(1) ^ _ 



rin{ ^ exp[/3(iJ,+ J2 h,i)s,]y{AA) 



S,=±l 



-rin{ 

+(3iPj\,Sj y 



pjijSiSj + l3Lpi\jSi 



(A5) 



The free energy F satisfies the thermodynamic relations: 
d{f3F)/dp = E, dF/dH, = and the extremum 

condition dF/dhji = 0. 



APPENDIX B: BELIEF-PROPAGATION ALGORITHM: 
MAGNETIC MOMENT AND THE BETHE FREE 
ENERGY 

Using the belief-propagation algorithm discussed in 
Sec. IVI.Ar2l we can easily calculate a local magnetic mo- 
ment: 



M, 



E 

S,=±l 



(Bl) 




b) 

n - 



J I 



^ m 



FIG. 43 Diagram representation of the beliefs (a) bi and (b) 
bji. Notations are explained in Fig. 1211 



where bi{Si) is the probability of finding a spin i in state 
Si. This probability is normalized, X)s =±1 ^'("^O ~ 
and related to the fixed point probabilities {fiji(Si)} and 
the probabihstic factor exp{l3HiSi), see Fig. H3l 

6,(5,) = ^e^^'^- n (B2) 
jeN(i) 

where A is a normalization constant. 

The correlation function Cij = (SiSj) is determined by 
the probability bij{Si,Sj) to simultaneously find neigh- 
boring spins i and j in spin states Si and Sj : 



Cij— SiSjbij{Si, Sj 



s,,s,-=±i 



where 



bij{Si, Sj) = bi{S.,). 



(B3) 



(B4) 



s,-=±i 



In the belief-propagation algorithm, the probabilities bi 
and bij are called "beliefs" . Using Fig. [43l we obtain 



(A3) 6y(5„5,) = 



X n n (B5) 

neN(j)\i neN(i)\] 

A t the fixed point, we find that dj is given by Eq. (|A1[) . 

lYedidia et all (|200l[ ) proved that at the fixed point the 
beliefs {bi,bij} give a local minimmn of the Bethe free 
energy ^b: 

FB{{bM) = E E ^^.(^-^.)i^t4I4t 

{ij) Si,Sj = ±l '^'■^^ ^' 

i s,=±i "f"'^^'' 

where V'i('S'i) = exp(/3i?,S',), 4iij{Si,Sj) = exp{i3HiSt + 



APPENDIX C: REPLICA TRICK 

The replica trick is a powerful mathematical method 
which allows one to average over a quenched disorder. We 
first introduce a statistical network ensemble, describe 
an average over a network ensemble, and then develop a 
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replica approach for the ferromagnetic Ising model on an 
uncorrelated random network. 

Let us consider the Erdos-Renyi graph of N vertices. 
The probability Pa{aij) that an edge between vertices i 
and j is present [aij = 1) or absent (a^j — 0) is 



We consider the ferromagnetic Ising model with = J 
i n a uniform field H , placed on the configuration model 
( Leone et al. Jsing an integral representation of 

the constrains 



Pa{a^,) = |<S(a., - 1) + (l - |)'5(a,,) (CI) '^(^a., - q.) 



^e«(E,a.,-,.)^.^ (C9) 

ZTT 



where a^- are the adjacency matrix elements, zi = (q) 
is average degree. Given that the matrix elements are 
independent and uncorrelated random parameters, the 
probability of realization of a graph with a given adja- 
cency matrix a^j, is the product of probabilities Po(aij) 
over all pairs of vertices: 



N-l N 

-piia.,}) = n n 



(C2) 



The average of a physical quantity A{{aij}) over the net- 
work ensemble is 



Af-l N 



(^>c„ = / M{a^,})v{{a,,}) n n ^« 

•J A — 1 A — I 1 



(C3) 



In the configuration model with a given degree distri- 
bution P{q) the probability of the realization of a given 
graph is 



N-l N N 



(C4) 

The delta-functions fix degrees of the vertices. A/" is a 
normalization factor: 



Af = exp P{q) Hzf/ql) - Nzi 

q 



(C5) 



Pa{aij) is given by the same Eq. (jCl|) . 

In the static model of a complex network (see 
Sec. III.E.2[) , a desired degree di is assigned to each ver- 
tex i. The probability that vertices i and j are linked is 
equal to pij. With the probability (1 — Pij) the edge (ij) 
is absent. We have 



Pa{aij) ^pij5{a.i.j - 1) + (1 -Pij)5{aij), 



(C6) 



where pij = 1 — exp{—Ndidj/N{d)). The probability 
P({ay }) is given by Eq. (IC^ . 

The replica trick is usually used for calculating an av- 
erage free energy {F)^^ = - {T\nZ)^^, where i--.)^^ is 
an average over a quenched disorder. The replica trick is 
based on the identity: 



(\nZ) = lim 



i.hmi^ii^. (C7) 

n^O n 



Let us demonstrate averaging over the statistical en- 
semble Eq. (jC4l) for the configuration model: 



N-l N 



(C8) 



i=l 



i—l j—i+1 



we integrate over with the probability function 
Pa{a,j) given by Eq. jCH): 



exp[pja,jStSj + iatj{tpt + ^pj)]Pa{aij)daij 



1 + fl(g/5./S,Sj+»(^,+^j) _ 



exp 



(CIO) 



where S, = {S^ , Sf, S^), S.S, ee Eo ^f^"; « = 
1, 2, n is the replica index. Note that one can simulta- 
neously integrate over random couplings Jij and random 
fields Hi. 

In the limit ^ 1 we obtain 



{5f=±l}' 



exp 



^^g/3js.s,+,(0.+V..) +^^HS. - i7Vzij,(Cll 



where HS^X^a^^*". 

Let us introduce a functional order parameter: 



where a — (cr^, a-"^, ...ja""). There is an identity: 



(C12) 



N ^ 



^ E P('^l)P('^2)f 



,/3 Jcricr2 



■iJ (71,(72 

(C13) 

We use the functional Hubbard-Stratonovich transforma- 
tion: 



exp 



E p{^i)p{^2y<'"'^' 



{ai,o-2=±l} 



= / -Dp(CT)exp E P('^i)C(f^i>cr2)p(CT2) 



(CM) 



Here C{(Ti, (T2) is an inverse function to e^''"'^'^^: 

EC((T,ai)e'^^'^i"^ =5(^-^2). (C15) 
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The transformation Eq. (|C14[) enables us to integrate 
over variables ipi in Eq. (|Clip : 

Cl ,(72 

+iV5]P(g)ln[^iziV(S)e^""] -^A^zi}. (C16) 

9 S ^' 

In the thermodynamic limit N oo^ the functional in- 
tegral over p{a) is calculated by using the saddle point 
method. The saddle point equations are 



Equation ([CTBl) gives the replica free energy per vertex: 
- nPFN-' = iV-i In (Z")^^ = -zi ^ + 



/3JcriCT2 



+ 



^P(<7)ln[^p«(S) 



,/9HS 



(C19) 



A replica symmetric solution of the saddle-point equa- 
tions (|C17P and (jClSP can be written in a general form: 



p(S) = J dh^{h) 
p{S) = / dh^{h) 



„/3hS 



(2 cosh ^ 

g/3hS 



(C20) 



(C21) 



(2cosh/3/i)"' 

where hS = Substituting the replica sym- 

metric solution into the saddle point equations (|C17p and 
(|C18I) . we obtain 



« 1 J ^ — T ^ — 1 



{hyn)dK 



■^{h) = /5(/i-Ttanh"^[tanh/?Jtanh/3y])$(y)dy.(C22) 



Substituting into the equation for ^'(/i), we ob- 

tain the self-consistent equation ([82| derived by using 
the Bethe-Peierls approximation, ^'(/i) is actually the 
distribution function of additional fields (messages) in a 
network. 



APPENDIX D: MAX-CUT ON THE ERDOS-RENYI 
GRAPH 

One can prove the validity of the upper bound Eq. ((99|) 
for the maximum cut Kc on the Erdos-Renyi graph, using 
the so called first-moment method. 



We divide the Erdos-Renyi graph into two sets of S and 
N — S vertices. The probability that a randomly chosen 
edge has endpoints from different sets is Q = 2(S'/iV)(l — 
S/N). The number of ways to divide a graph by a cut of 
K edges is 



m{K) 



N 

E 

s=o 



L-K 



(Dl) 



Here (^) is the number of ways to choose K edges from 
L edges, (^) is the number of ways to choose 5* vertices 
(C17) from N vertices, {1 — Q)^~^ is the probability that 
there are K edges in the cut, and the L — K remaining 
edges do not belong to the cut. The main contribution 
to OT(i^) is given by terms with S « N/2, i.e., Q w 1/2. 
So, 



(D2) 



where a — K / L. Using the entropy bound on the bino- 
mial, 



we find 



s; exp[-L(l - a)ln(l - a) - Xalna], (D3) 



S(a) = -(l-a)ln(l-a)-alna+(zi/2-l)ln2. (D4) 

The maximum cut Kc is given by the condition S(ac) = 
0. In the limit N oo, there is no cut with a size 
K > acL = Kc while there are exponentially many cuts 
a.i K < Kc. This condition at zi > 1 leads to Eq. ((99l) 
with the upper bound A =^ Vln 2/2. 



APPENDIX E: EQUATIONS OF STATE OF THE POTTS 
MODEL ON A NETWORK 



iDorogovtsev et al\ (|2004 showed that for the ferro- 
magnetic p-state Potts model Eq. (I119P on an uncorre- 

lated random graph, the magnetic moments Mi = M^'^' 
along the magnetic field H and the additional fields (mes- 
sages) hij are determined by the following equations: 



A/,; 



1 - exp[-/3(i/ + Y., 



h,i)] 



1 + (p - 1) exph/3(i7 + E,eA^(.) %)] 
eP-h, + (p - l)e-'3v.u 



hii — Tin >, ^ 7i— 



,(E1) 
(E2) 



where Lpi\j = H + I]me7V(j)\j is the cavity field. 
These equations unify the percolation, the ferromagnetic 
Ising model and a first order phase transition on uncor- 
related complex networks. They are exact in the limit 
N ^ oo. 
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For the one-state ferromagnetic Potts model in zero 
field, Eq. (|E2[) takes a simple form: 

Xij^l-r + r Y\_ ^rni, (E3) 

meN{i)\j 

where Xij = exp(— /lij), the coupling Jij = J > 0, and 
r = (1 — e"'^"'). In the configuration model, the pa- 
rameters Xmi are statistically independent. Averaging 
over the network ensemble and introducing the parame- 
ter X = (xij)^^, we arrive at Eq. (fH|) describing bond per- 
colation on uncorrelated networks. The critical tempera- 
ture Tp in Eq. (|121[) determines the percolation threshold 
r(T = Tp) = z\l zi in agreement with Eq. p7p . 

When p = 2, equation (|E2|1 is reduced to Eq. ([60| for 
the Ising model. It is only necessary to rescale J 2 J, 
H 2H, and h ^ 2h. 
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